The modern Estonian name of the town comes from the limestone rock on which all of northern Estonia is located. The first historical name of the town "Weissenstein" also meant "light stone" from German, similar to the name adopted in Polish nomenclature - White Stone. The history of the village dates back to the 13th century, when the northernmost Teutonic fortress was erected at the crossroads of the Livonian routes, bordering the areas then under Danish rule. The first stone fortifications (including the central mighty tower) were erected in 1265 on the initiative of the Teutonic Knights' National Master of Inflants, Konrad von Mandern. Initially, the castle functioned in the monastic hierarchy as the seat of the aldermanship, while a settlement was established around the fortress, which was granted town rights in 1291. The economic development of the centre and the increase in military importance resulted in the castle being elevated to the rank of komturia at the beginning of the 14th century. Historical sources cite Raimar Hahn as the first commander in office in Weissenstein between 1314 and 1316. The castle witnessed important events during the Estonian uprising on the night of St. George in the spring of 1343. It was here that negotiations took place between the four leaders of the uprising delegated from the elders (later described as "Estonian kings"), whom the Teutonic Knights secretly imprisoned and then murdered. Biały Kamień went down in Polish history twice in the early 17th century as a place of glory for Polish arms. This took place during the Second Polish-Swedish War. For the first time, the fortress was captured by Polish troops at the end of September 1602. The siege lasted four months and was the last campaign commanded by the Great Crown Hetman Jan Zamoyski. Another victory at Biale Kamień occurred on 25 September 1604. At that time, a Polish army of 2,000 under the command of the Royal Governor, Field Hetman Jan Karol Chodkiewicz, clashed with a 7,000-strong Swedish army led by Arvid Stälarm and the Spanish mercenary Alonzo Cacho de Canuta. Crucial to the outcome of the battle was the charge of the Polish hussars, which shattered the enemy's main forces. The Poles lost less than 100 soldiers in the battle, with around 3,000 Swedes dead. Polish rule did not last long, however, and after only four years the castle was returned to Sweden. Partially destroyed, the stronghold soon lost its military significance, gradually falling into ruin. The rank of the town also declined, and it lost its municipal rights in 1636, only regaining them again in the second half of the 18th century.

Present-day Paide is a provincial town of less than 8,000 inhabitants, which is sometimes referred to as the "heart of Estonia" because of its central location. The main Estonian agglomerations are roughly the same distance away: Tallinn (90 km), Tartu (100 km) and Parnava (105 km). For this reason, for a certain period in the 20th century, the symbol of the heart appeared on the town's coat of arms. Nowadays, the historical town coat of arms with the white castle tower, which remains the most characteristic element of the town's architecture, has been returned. Visible from afar, the soaring octagonal building 30 m high is the most impressive remnant of the medieval fortress of the Order of the Knights of the Sword. However, it is a faithful reconstruction of it made in the first half of the 1990s. The original building survived for nearly seven centuries, but was blown up by retreating Soviet troops in 1941. Today, five levels inside the building house a museum exhibition on the history of the castle and the city (the highest level serves as an observation deck). The area of the former castle was adapted into a walking park with an amphitheatre. Apart from the main tower (commonly referred to as the "Long Herman" tower), the defensive layout of the castle has been preserved, with four bastions and stone relics of fortifications: the gunpowder tower and water gate (north-eastern corner), the western gate (adjacent to the main tower), the curtain wall (from the north-western side) and the uncovered foundations of the former buildings (probably: the chapel, chapterhouse and refectory). The parish church of St. Cross adjoins the castle hill from the south. The church received its stone form in the 18th century, but was rebuilt after a fire in 1845. In its preserved form, it is a single-nave church set on a rectangular plan with a massive tower (topped by a soaring dome with a spire) adjoining the southern wall of the nave. As a result of a reconstruction carried out at the beginning of the 20th century, the church represents the Neo-Gothic style. In the vicinity is the former market square (now planted with trees) with municipal buildings partly dating from the 19th century. The southern frontage of the square is occupied by the imposing two-storey town hall building with an Art Nouveau façade, built in 1920.