Kerala Chief Minister Pinarayi Vijayan on Wednesday categorically made it clear that his government won't backtrack from the Vizhinjam seaport project and said the recent violent agitations against the multi-crore initiative was with a "clear ulterior intention" to destroy tranquility in the society.