We lived at Summer House in downtown and we really loved it. We were there on similar circumstances, my partner was getting her doctorate in Fairfield and I commuted to NYC. They have a shuttle service for the morning and evening hours, even then walking to the train is a short walk (i did it many times if i missed a shuttle).