Fix gcc warnings with -Wpointer-sign

Fixes https://gitlab.freedesktop.org/fontconfig/fontconfig/issues/184
5 files changed