A replacement purge plug containing a refractory material is configured to be inserted in the bottom of a ladle for introducing purging gas through a heat of molten metal in a ladle. One or more geometrical features on the lateral surface of the purge plug facilitate the installation of the purge plug into a housing block that has been subjected to erosion.