Most of the warmth on a short walk comes from the head and neck. A close knit hat and a light scarf do more than an extra jumper.
Choose colours that already live in the wardrobe so the extras do not feel like a costume. The child should still look like themselves.