Population help please

3 of the 8 villagers have died and im trying to get more children but have tried numerous times to have the remaining villagers go "indoors" , but i still have not gotten a baby. Please help. I have 2 males and 3 females left 2 or 3 which are elderly.

elderly female villager cant have baby. but elderly male villager can make other female (not elderly) villager pregnant