gender is determined before the fetus stage. but physically you couldnt tell for a while.
but yeah the chromosomes do start out as female before things start multiplying.
thats why gender forget ups like hermaphrodites and other such odds, always appear female.