The Congress on Friday accused the government of withdrawing security personnel from around Rahul Gandhi as the Bharat Jodo Yatra reached near Qazigund in Jammu and Kashmir, and demanded action against those responsible for the alleged security breach.