In the meantime, the castle remained in the hands of the Elector of Saxony. Located in the middle of forests rich in wilderness, the castle was mainly used as a hunting lodge in the 16th and 17th centuries. For this purpose, the lower castle (today House 1) was built 1550 and a bear garden was created 1609 on the outskirts of the city. Until 1861 the castle was the official seat as well as a prison and was later used as a state reformatory . After the constitution of the Weimar Republic, the castle served as a branch of the Bautzen prison from 1919 to 1924 . From 1926 the castle was used as a youth hostel. Summer camps, courses, seminars and conferences took place. 1928 also moved the puppeteer Max Jacob (1888-1967) with his group to the castle. In addition to the tours, the Puppet Theater played in Hohnstein during the summer months. International delegations were also guests at the castle, with the visit of the Bengali philosopher and poet Rabindranath Tagore (1861-1941) being a special highlight in 1930 . As early as March 1933 the castle was supposed to become a protective custody camp Hohnstein for 18 months. After that, from 1935 onwards, the facility served the Hitler Youth as a Reich Youth Hostel. With the beginning of the Second World War 1939 a prison camp for Polish and later also French officers was established. 1941 the officers’ camp was closed and Soviet and Yugoslav prisoners of war were interned at the castle. After the end of the war 1945 refugees found accommodation here before a youth hostel could be reopened in 1949 . After 1990 the castle remained the property of the district and from 1996 was leased to the Friends of Nature Association, which used the area as a youth hostel and event location until 2017 business. 2018 the city of Hohnstein took over the administration of the castle.