Police in Maharashtra's Thane city have arrested Hindu religious leader Kalicharan Maharaj in Chhattisgarh in connection with a case registered against him here for allegedly making derogatory remarks against Mahatma Gandhi, an official said on Thursday.