Do you think Homophobes are “afraid” of gay people?

Yes.

What abiut transphobes?

Also yes.

In the context of bigotry, phobia is used to refer to invalidating or undermining ones sexuality, gender identity, etc.

That is the outcome of the irrational fear people feel towards those people.

Someone attracted to trans people because they are trans would be transphilic, not transphobic.