PRIME Minister John Howard and Treasurer Peter Costello are under pressure to distance themselves from an evangelical church leader who has spoken at a meeting of the far right-wing League of Rights.

Pastor Danny Nalliah, the head of Melbourne-based Catch the Fire Ministries, has confirmed he addressed the group, despite being warned that they were "anti-Jewish".

Pastor Nalliah has been given top-level access in recent months to the Howard Government, which he has endorsed enthusiastically.

The revelation of his speech in 2005 has prompted Labor to call on the Government to cease contact with Pastor Nalliah.

The row came as the Coalition yesterday sought to promote its Christian credentials at the expense of Labor. Health Minister Tony Abbott said Labor MPs did not have the same Christian commitment as those from the Coalition.

Mr Nalliah made headlines after he was charged in a test case of Victoria's religious vilification laws for comments he made about Muslims in 2002.