In order to be able safely to insert or remove a side-wall insulating panel (4) for the storage core of a heat storage stove having a ceiling insulating panel (6) at risk of fracture, the ceiling insulating panel (6) is secured by means of an auxiliary supporting rail (9). <IMAGE>