Skip to main content

Assert no lock required

This is a technique I learnt about from Jason Gregory's excellent book, Game Engine Architecture (3rd Edition).

If you have a shared resource accessed by multiple threads, where you're fairly certain that it's only ever accessed by one thread at a time, you can use an assert() to check for this at debug time without having to pay the runtime cost of locking a mutex.

The implementation is fairly straightforward:

class UnnecessaryMutex {
public:
  void lock() {
    assert(!_locked);
    _locked = true;
  }

  void unlock() {
    assert(_locked);
    _locked = false;
  }

private:
  volatile bool _locked = false;
};

#ifdef ENABLE_LOCK_ASSERTS
  #define BEGIN_ASSERT_LOCK_NOT_REQUIRED(mutex) (mutex).lock()
  #define END_ASSERT_LOCK_NOT_REQUIRED(mutex)   (mutex).unlock()
#else
  #define BEGIN_ASSERT_LOCK_NOT_REQUIRED(mutex)
  #define END_ASSERT_LOCK_NOT_REQUIRED(mutex)
#endif

Usage is equally straightforward:

UnnecessaryMutex gMutex;

void PossiblyOverlappingFunction()
{
  BEGIN_ASSERT_LOCK_NOT_REQUIRED(gMutex);
  // ... do critical section operations ...
  END_ASSERT_LOCK_NOT_REQUIRED(gMutex);
}

There are a few caveats with this though.

First is that it's not 100% reliable, because it favors minimal runtime cost over perfect accuracy. It should catch most cases where two critical sections overlap, but it's vulnerable to race conditions. Declaring the _locked variable volatile doesn't prevent these, it just means access to the variable can't be optimised away. The book makes the point that is probably sufficient if combined with good enough testing.

If you need better accuracy, you could use a std::atomic<bool> instead, with appropriate memory orderings. This will increase the runtime overhead a bit, but if the mutex is locked and unlocked very frequently that may still be ok for your use case. It may be useful to have a #define controlling which implementation is used, so that if the fast version detects a problem you can switch to the slower but more accurate version to help track down the problem.

If you want 100% accuracy you could use a real mutex and assert on whether try_lock() succeeds.

The second caveat is that its not a recursive mutex. If you try to obtain the lock a second time from the thread that's already holding it, that will still trigger the assert. The general idea does still apply for recursive mutexes, but the implementation of the UnnecessaryMutex class gets a little more complicated: it would need to keep track of which thread it's locked by and a count of how many times it's been locked, instead of just a boolean.

An RAII-style wrapper for UnnecessaryMutex, which locks the mutex on construction and unlocks it on destruction, can be a useful addition to this.

What I've said here is mostly just rephrasing of what can be found in the book, which has lots of other useful stuff besides this.

Comments

Popular posts from this blog

LD_DEBUG

Posting this mainly as a reminder to myself... If you ever find yourself needing to figure out a dynamic library loading problem on Linux, LD_DEBUG can be a massive help. This is an environment variable you can set to make the dynamic linker print out a ton of useful diagnostic info. There are a number of different values which control the amount and type of diagnostics printed. One of the values is help; if you set LD_DEBUG to this and run executable it will print out a list of all the available options along with brief descriptions. For example, on my Linux workstation at the office: > LD_DEBUG=help cat Valid options for the LD_DEBUG environment variable are: libs display library search paths reloc display relocation processing files display progress for input file symbols display symbol table processing bindings display information about symbol binding versions display version dependencies all all previous options combi...

How to outperform std::vector in 1 easy step

Everyone who's familiar with C++ knows that you should avoid resizing a std::vector inside a loop wherever possible. The reasoning's pretty obvious: the memory allocated for the vector doubles in size each time it fills up and that doubling is a costly operation. Have you ever wondered why it's so costly though? It's tempting to assume that because implementations of the STL have been around for so long that they must be pretty efficient. It turns out that's a bad assumption because the problem, in this case, is the standard itself: specifically, the allocator interface. The allocator interface provides two methods that obtain and release memory: allocate allocates uninitialized storage (public member function) deallocate deallocates storage (public member function) (taken from this page ). What's missing is a   way of growing an existing memory allocation in place. In C this is provided by the realloc function, but there's no equiva...