After catching The Great Gatsby on late night telly...
What about taking the Long Island Railroad either to the North Shore - wineries and Gatsby era mansions - or the South Shore - for strolling along the beaches of "The Hamptons" off-season.
Apparently, accommodation plummets in price, and the weather is usually still pleasant enough until mid-October.