Two controversial BJP ministers, who participated in a rally in support of the people arrested for the rape-cum-murder of an eight-year-old Muslim girl in Kathua, today exited from the PDP-BJP alliance government in Jammu and Kashmir, ending a simmering political crisis in the state.