Move the bits sanity checking a bit higher in the function

Saves some time and makes the code simpler as we have to delete one
thing less