It is too easy for most unions to become corrupted by self interested parties. It’s the same with any human endeavour. Relax the boundaries enough and people with less scruples than you will worm their way in.
There’s needs to be legislative framework that protects the rights of every worker, every industry, everywhere as a baseline. Then construct sensible unions for various industries from there. Otherwise they become fragile, susceptible to personal influence - who’s going to run against a 10 year incumbent union president?- it needs an iron core underlying it to protect workers rights.
I saw one suggestion which was to so away with male and female competitions, and instead have “open” and “restricted” comps. Open would be available to anyone, male or female, while you could set up as many restricted comps as you needed for the particular sport or activity with whatever rules make sense. So the 100m sprint might have Open, Restricted - Testosterone, and Restricted - Height - with whatever T level or height in centimetres decided by the relevant authority. Whereas something like weightlifting might have Restricted - Weight as it’s own class. The idea being any gender can compete provided provided meet the restrictions in place to make an interesting/fair competition within that bracket.