They didn't REALLY support Britain. Washington himself wished to stay neutral because he feared war would be too much for this new and fragile nation.
The thing is, the Federalists knew opposing the superpower of the world was like a suicide mission. They also had no reason to oppose Britain either.
Your answer would be for economical (and even political) reasons they wanted to stay on Britain's good side. For their own sake.
