Make unsigned casts for byte swapp operations

This fixes errors like:

error: result of '3407872 << 24' requires 47 bits to represent, but 'int' only has 32 bits [-Werror=shift-overflow=]