No, that's not embarrassing, I agree that some of the smaller towns in VT actually have nice little walkable downtowns. Brattleboro is definitely included in that.

The issue is more that those downtowns are quite small and once you get outside of them the walkability drops off completely as it generally becomes immediately rural. For some people that's fine, but I like density and being able to walk around more than just a small downtown area, so even though I enjoy visiting these places I'm not sure I could live in them.

I have a similar issue with coastal Maine outside of Portland. I love a lot of the coastal towns, and they often have great little downtowns, but that's it for the walkability and they are basically small islands of walkability all separated from each other.