Because Baby Villagers are only made if there is available housing to be filled. If you add a stuffload of houses (Solid roof, not glass or leaves. Wooden doors), they will make Baby Villagers. Back when the Span forgetloads of Doors Makes stuffloads of Villagers bug still worked, I saw tons of children.