Expressing disappointment over his reccomendations in the appointment of state backward castes panel members being "ignored", Uttar Pradesh Cabinet Minister Om Prakash Rajbhar on Thursday said he would hand over the charge of the backward class welfare department to Chief Minister Yogi Adityanath.