The most conveniently located bed and breakfast in downtown Williamsburg VA. the Fife and Drum Inn is located between the Colonial Williamsburg Historic Area and the College of William and Mary. From the inn’s front door, the College Admissions Office is just a two-block walk west, and the colonial Governor’s Palace is a two-block walk east.