Police have said they are “extremely concerned” about the baby’s mother’s welfare.