Too Much Help by Fran Stallings

A group of villagers doesn’t clean up after themselves so when their town gets too dirty or rat-infested to live in they simply pick up and leave without trying to solve the problem, until they meet a old man with magical skills.