After initially agreeing to attend Prime Minister Narendra Modi's swearing-in ceremony, West Bengal chief minister Mamata Banerjee on Wednesday said that she will not attend the oath-taking ceremony on Thursday after the BJP sent invites to the families of its workers killed in the state.