Sport is just a form of entertainment for the masses and is also extremely selective. You can't play professional basketball if you are not tall enough no matter how good you are. And not all sports have a physical advantage for men. So I am personally fine with banning trans people at professional levels if other unfair physical advantages were banned as well, for example people born with excess hemoglobin in the blood, intersex people etc. But then you'd just end up with mediocre athletes, because the best athletes are all basically exceptional in some regard. When you devote a lifetime to shaving off a fraction of a second and have a team versed in sport science then it's not all down to talent.
So you need to ask yourself which freaks you want to see performing for your entertainment.
So you need to ask yourself which freaks you want to see performing for your entertainment.