After the unsuccessful defence of Grodno, which took place on 20-22 September 1939, some soldiers were retreating towards Lithuania. While resting in a forest near Kaleta, they were surprised by the Soviets, who opened fire on the defenceless and surrendering Polish soldiers. Some of the soldiers managed to escape, but about 30 were killed. The local population buried them at the site of their deaths. In 1989, the remains of the soldiers were exhumed and placed in a common grave next to the church, which was burnt down in 1944.

Apart from the exhumed soldiers, other people were also buried in this grave:

- Lieutenant Stanisław Dobrzański (Dobrzyński) - killed by the Soviets on 22.09.1939 at the Augustow Canal in Dąbrówka,

- Teofila Olszewska - burnt down in 1944,

- Antoni Wilczyński - teacher, shot at home.

The cemetery was fenced with a wooden fence and there were 5 crosses: a central wooden one with a plaque (dedicated to the soldiers of the Polish Army), two metal ones with plaques and two wooden ones with plaques.

In 1994, after the church was rebuilt, the appearance of this quarter was changed - all crosses were replaced by a common concrete monument in the shape of a Virtuti Militari cross. Unfortunately, the inscription plaque does not contain any names of those buried. The inscription reads: "To those who died and those who live / To the Soldiers of the Polish Army / fallen in Kalety / on 23 September 1939".