Union Minister Smriti Irani on Thursday took a swipe at Congress leader Rahul Gandhi saying he is the "political master" of his party and that "arrogance" caused his defeat in Amethi, a seat that the grand old party had held "as a family" for over four decades.