The Hickory House was brought to this location in the early forties by a local doctor. The main old building was built in the bahamas and floated to this spot. At one time it was used by Catholic nuns as a retreat and later on it was a fishing camp frequented by some of Key West's most colorful characters. It has been long rumored by some that during the second World War it was known as "Mom's" was
a house of ill repute and was off limits to U.S service men. We don't really know this for sure. Other folks say they were two different places located on the same road in a rather remote area. In the mid fifties it was sold to a local family.

This family ran a drive in on Flagler Ave. Some time in the mid to late fifties they moved the drive-in to this location. They refurbished the old shack with open windows and picnic tables. There was a veranda that went around the building. The menu consisted of hotdogs, burgers, chili, & milk shakes. Jimmy's drive-in grew very popular. Over time they began selling barbaque beef , perk and steaks. Everyone in the Key West ate at the Hickory House. It was the spot. All the locals, politicians, crooks, famous people, and common folks went out to dinner at the Hickory House. In the early eighties the proprietor passed away. His family continued to run the Hickory House but the spirit could not be duplicated. Smugglers were in their hey day during the eighties. Rumor has it that these docks saw plenty of action. We suspect the mural on the bar wall tells the story. So after several years of being opened and closed the family decided it was time for a change. The property was put up for sale. After much renovating the Hickory House was reborn in spring of nineteen ninety-eight. It is our hope that the spirit of its earlier days can be felt by all you pass through the door. It is our sincere desire that you enjoy your meal, the surroundings, our staff and the spectacular sunset view.