When I was a kid, late 70s maybe, there was a TV movie that I saw that had a mummified baby in the cellar. A person goes down to check on it and it is gone. The person starts to go upstairs and the door to the cellar closes and locks. And you hear scraping as if the mummified baby is crawling across the floor to get the person who is trapped.
“The Offspring”(1987)? a.k.a. “From a Whisper to a Scream”. A horror anthology in which the 1st story features a demonic baby.