Perhaps the most quintessential factor of Port Jefferson would be its eateries. Restaurants, especially seafood ones, are a given within the harbor. However, the most famous of these, with good reason, is PJ Lobster House.