The Horniman Museum and surrounding grounds are a great place to take children. Free, spacious, with a great cafe.
We've gone there a couple of times now and Kai adored the aquarium. As for the museum itself, Kai wasn't really bothered with all the exhibits, he just liked having the space to run around.