The former PM said the fight for marriage equality was “trashing our country’s history”.
The group slammed Senator James Paterson’s opposing bill and called it “legalised homophobia”.
The new conservative bill will offer protection to anyone from being forced to participate in a same-sex wedding “against their beliefs”.
“I’m not against them getting married, as long as a bullet goes through their head the moment they kiss”
He described the behaviour of churches during the campaign as “callous and un-Christ-like”.
“LGBTI people will be told to accept new forms of discrimination in return for our right to marry, or continue to be excluded from marriage”
The No campaign has had to distance itself from the comments.
The gay conservative has been linked with white supremacists and neo-Nazis.