I don’t choose what I say with concern to whether bigots will misuse it TBH. I’d argue pretending things that are happening aren’t also gives them ammo.
You’ve got to police your own borders, same as antisemitism on the left. Being aware of the dangerous fringes of your own movement keeps that movement strong. Look at the fallout from PIE in the 70s, or Rotherham, or AS, or supporting despots because they’re anti west/capitalist. I don’t think pretending there’s not sometimes failures in progressive movements does anything but give ammo to be honest.
There’s a significant amount of gay and lesbian people who don’t like it either precisely because it enables those stereotypes.