Lived in Milford for 10 years. Its an amazing town. Just be warned home prices have grown a lot over the last 3 years, more than most places in CT.  Its also over-crowded. If there's the tiniest lot available, someone will build on it. Parking downtown or at the beaches has become unbearable. 
   Some streets flood, including ones a mile away from the beach. There are some neighborhoods barely above sea level, so do your research. Those are obviously the ones on the water. 
  I still recommend it. Its got everything! But do your research. That can be said about any place.