Cong struggling to hold back its MPs and MLAs