A day after the Congress Working Committee put its weight behind Sonia Gandhi and asked her to initiate necessary changes in the party, senior Congress leader Mallikarjun Kharge on Monday said all the party MPs and leaders in states are responsible for the poll debacle and not the Gandhi family.