The flag of Jammu and Kashmir which used to fly along with the tricolour was removed from the Civil Secretariat in Srinagar on Sunday, three weeks after the Centre revoked Article 370 provisions which granted special status to the state, officials said.