I saw this film in the late 70s or early 80s. I think I saw it at school, but if not, it would have been on TV. It was short, maybe 5 or 10 minutes long.
The setting was outdoors and it was in color. There was no dialogue, or at least none that I remember. The main character was a man. The plot involved a series of visitors dropping by. Some might have been animals, but others were people. He would enjoy their company at first, but then something would go wrong. He would send them away angrily, then build his fences or walls higher and higher.
The part that I remember most vividly is that when the walls were quite high, the only visitors who could get in were acrobats, who performed for him before being sent away.