The Whalesbone has great oysters and smoked fish platters:
https://thewhalesbone.com
North and Navy has some great food as well:
Http://www.northandnavy.com
But it depends on where you're going to be staying, and how far you're willing to go to eat. The Byward Market is always a fun trip.