Lot of great ideas already. East Rock Park and West Rock for city views. Tons of good food options, NEBCO brewery is just outside of New Haven if you are into beer.

You could check out the shoreline towns like Madison and Guilford too.

G Cafe or Pistachio would be good spots to start your day with a coffee and pastry/breakfast sandwich.