The Kostrovickis' residence was located near the now defunct Suboča gate, on a hill (121 metres above sea level) with a nice exposure to St Casimir's Church. It was built before 1642. What is interesting and rare in Vilnius, the palace did not stand in the street frontage, but "in a side lane" with a square - the forecourt, where there were farm buildings, including a kitchen and a stable with a coach house. The seat was erected by Aleksander Juszkiewicz and his wife Regina, née Dubowicz. On 9 June 1642, they bequeathed the brick residence to Jan Kostrowicki, who married their only daughter, Helena.

Situated on the north-south axis, the two-storey and basement palace took the shape of a quadrangle with an inner paved courtyard, which was associated with the castle. This effect was enhanced by two vantage points that monumentalised the building. The first of these was located on Subačiaus g. (Subačiaus Street), because in front of the residence, as mentioned, an extensive forecourt was organised, which is still legible today. The second vantage point was on former Augustinska Street (Šv. Kazimiero g.), behind St. Casimir's Church, which is located lower than the Kostrovicky Palace. Hence the attention given to the artistic design of the garden façade, decorated with a nice drawing of the cornices.

Despite the pronounced curvature of the palace plan, an effort was made to emphasise the main axis through the gate and the vestibule in the north wing, lying almost opposite, from where one could access the garden. The interiors of the palace were single-arched and partly vaulted in the lower storey and covered with ceilings in the upper storey. Communication between floors was provided by external wooden galleries (some of which still function today) located at the eastern and southern wings and staircases.

south wing, and staircases: in the west wing and an auxiliary one in the north-east tower annex. In the opposite corner on the east side was a second tower annex, on the first floor concealing a bedroom. The gate passage itself was covered with a cross vault with lunettes and stucco mouldings, the shape of which suggests that artists connected with the Lublin region were active at the palace. Behind the palace on the slopes of the hill was an extensive garden.

In the hands of the Kostrowickis of the Strzała coat of arms, who came from a Unitarian merchant family that gained ennoblement through the exercise of power in the magistrate's office by their representatives, the residence was in place until 1689 at the latest. The following year, the sources mention Boguslav Aleksander Uniechowski (d. 1697), Voivode of Troki, as the possessor. At the beginning of the 18th century, the palace became the property of Jakub from Skrzynno Dunin (1680-1730), Crown Referendary. In 1737 the estate was described as belonging to the widow Helena of Potocki (d. 1762).

After the Dunin family, the estate was taken over by Jan Michał of Dovojny Sollohub (d. 1748), treasurer of Lithuania associated with the Radziwills, followed by his elder son Józef (1709-1781), castellan of Vitebsk and later provincial governor. At that time, the palace was renovated, among others by the mason Stanislaw and carpenter Andrew. The rooms on the first floor were more richly decorated, including cookers made of white tiles, some of which were decorated with flowers.

At the end of the 18th century, the palace was briefly managed by the Daughters of Charity, who ran a hospital nearby. Already at the beginning of the 19th century, the property was in the possession of Vilnius mayor Wincenty Malinowski (d. 1829) and his wife Bogumila, née Kulikowska. Before 1808 a building was added to the palace on the neighbouring property, and before 1865 the palace was extended on the eastern side, incorporating the tower annexes into the new tract. Part of the garden was also detached from the plot. In the 1840s, the residence was described as "completely decayed". Nevertheless, ongoing renovations were undertaken in the following decades. The building is still used for residential purposes today.