Khori means cave (Guffa) and Shiv Khori thus denotes Shiva's cave. This natural cave is about 200 metres long, one metre wide and two to three metres high and contains a self made lingam, which according to the people is unending. The first entrance of the cave is so wide that 300 devotees can be accommodated at a time. Its cavern is spacious to accommodate large number of people. The inner chamber of the cave is smaller.

The passage from outer to the inner chamber is low and small, at one spot it divides itself into two parts. One of these is believed to have led to Kashmir where Swami Amarnath cave is located. It is now closed as some sadhus who dared to go ahead never returned.[citation needed] To reach the sanctum sanctorum, one has to stoop low, crawl or adjust his body sideward. Inside a naturally created image of Lord Shiva, about 4 metres high, is visible. The cave abounds with a number of other natural objects having resemblance with Goddess Parvati, Ganesha and Nandigan. The cave roof is etched with snake formations, the water trickles through these on Shiva Lingam. Pigeons are also seen here like Swami Amar Nath cave which presents good omens for pilgrimages.