There is evidence that the caves were inhabited during the Neolithic, Bronze and Iron Ages. Excavations have found flint tools and fragments of ceramics. It is assumed that during the Second Bulgarian Kingdom (12th-14th centuries) the caves housed hermit monks. Nearby there are remains of a small church that was named after the Holy Virgin. The place is called Khan Krum's Gates because of the legend that Khan Krum watched over the area from there.
