According to a legend and religious experts, these particular caves largely date to the time of the Mahabharata. It is strongly believed that the Pandavas during their "Agayatwas" (exile) stayed in those caves for a short period. It actually served as the shelter of the Pandavas. It is actually situated at the hilltop. With a copper Yoni, it has a white marble Shivling. It is to be highly noted that the said Shivling is perfectly surrounded by the idols of Lord Ganesha, Lord Brahma, Goddess Paravati, Lord Vishnu and Lord Hanuman.