X and Y chromosomes determine whether you are born with male genitalia or female genitalia. I doubt anyone denies that science.
It may be that people use the words "biological sex" to mean different things, but that is a pedantic disagreement, not a scientific disagreement.