Builder of the Hardheimer Palace is the country squire Wolf von Hardheim and his wife Margareta von Berlichingen, as can be read in an inscription above the entrance portal. Master builder was Urban Khaltschmid from Lindau. The community Hardheim bought it in 1858 from the grand duchy Baden. In the year of purchase it was converted into a primary school (Sunday school) with teacher's flat. It was also used for ecclesiastical concerns. In the year 1929 the community administration relocated its seat from the Town Hall at the market place to the palace.