The Rabí Castle was founded around 1350 as a fort above the Otava River. During the 14th and the 15th century the castle was being rebuilt and enlarged into the huge castle premises and it became a representative residence of the Lords of Rýzmberk. The castle of Rabí kept its residential function till the end of the 17th century.

The devastation of this castle began in the first half of the 18th century when a fire destroyed its roofs and wooden parts. Moreover, the abandoned castle premises was a source of building materials for people living under the castle and in its surroundings.

Since 1950s the Rabí Castle has been belonging to Czech state and in 1978 it became National Cultural Heritage. Since 2013 National Heritage Institute, Regional Historic Sites Managment in České Budějovice [Národní památkový ústav, územní památková správa v Českých Budějovicích]  has been taking care about the castle premises.

Nowadays the Castle of Rabí offers guided tours and also various cultural events (concerts, theatre performances, puppet theatre).