Revert "Change BigEndian casts to be int-sized"

This reverts commit eb5ddd32bf4e458ca0af8d5784f8fd46485ad225.

Broke tests, badly.  To be investigated and reenabled.
1 file changed