AICC president Mallikarjun Kharge on Wednesday hit out at Prime Minister Narendra Modi over the Enforcement Directorate attaching assets of the party-promoted National Herald newspaper and said they will not be scared of the BJP and that the Congress will fight it out.