How about Bury St Edmunds, The Angel? Not in the country as such (although Bury is a nice market town) but it is a lovely interesting hotel with good food and you also get a great musical connection:
My parents lived in Dedham (Essex/Suffolk border) for 20 years. We occasionally went to Milsoms which is high end dining and very smart. Not cheap though.