Around 2200 years back, Dongargarh was a reasonably denied region named Kamavati managed by Maharaja Kamsen additionally called Kamakhya Nagri. At the point when his Queen brought forth a child they named him Madansen. Since Raja Veersen thought of it as a gift of Lord Shiv and Parvati, he built the sanctuary of Shri Bamleshwari Mandir at Dongargarh. Presently Raja Madansen had a child named Kamsen in view of whom the zone got to be renowned and came to be known as Kamakhaya Nagari.
A major fight occurred between Raja Kamsen and Raja Vikramaditya, reason being the adoration between Maadhavnal and Kaamkandla, which prompted to the total devastation of KAMAVATI. Legend has it that after the demise of Maadhavnal and Kaamkandala, Raja Vikramaditya felt regretful as he suspected that he was in charge of Kaamkandala submitting suicide. He experienced profound anguish and began steady love, bringing about Maa Bagulamukhi Devi showing up before him.
Raja Vikramaditya asked for the goddess to make both Maadhavnal and Kaamkandala alive again furthermore requested that Maa Bagulamukhi Devi remain at the sanctuary. From that point forward it is trusted that Maa Bagulamukhi Devi is available here. As time go by the name got changed from Maa Bagulamukhi to Maa Bamlai to Shri Bamleshwari Mandir as it is known today.