libsailfishkeyprovider: Only compile the lib to reduce the amount of weird linking errors (eg: with tests)