Britain-based Taji Mustafa from the Muslim political group Hizb ut-Tahrir flew out of Australia on Monday night, leaving behind a trail of controversy after the Opposition tagged him as a hate preacher and called for the cancellation of his visa.

However, before his flight, Mr Mustafa - who addressed on Sunday the Sydney Islam conference titled Muslim's Rise - Caliphate Imminent - made statements that could fuel the Coalition's charge that he preaches hatred.

Although he expressed concern about the violent Saturday protest that resulted in injury to 17 people, Mr Mustafa said the rally was good for the wider audience to witness growing global anger against the United States. He said the anger was not just over the video Innocence of Muslims posted on YouTube.

"The film really is a trigger for many deep-seated feelings about the actions of Western governments in the Muslim world. Many Muslims feel under attack - not physically on the streets of Melbourne or Canberra, but when they look to their brothers and sisters in Iraq, they see physical occupation," ABC quoted Mr Mustafa who is for peaceful political protests.

Julie Bishop of the Coalition pointed out the group called for military destruction at its conference in Sydney in 2011 while one of their leaders approved of the killing of Australian soldiers in Afghanistan.

However, Immigration Minister Chris Bowen stressed the Islamic political party is not flagged as a terrorist movement.

Ms Bishop emphasised that the anti-Islam video was not produced or endorsed by the U.S. government and even condemned by American officials.

"The rioters had no reason whatsoever for seeking to violence the offices of the U.S. consulate in Sydney," she pointed out.

"Clearly this is not done in the name of Islam, and it is not done in the name of multiculturalism - this is actually an anathema to both of these principles . . . It is done in the name of thuggery and nothing short of that," said Mr Bowen.

The minister warned on Monday non-citizens who participated in the Saturday protest that the federal government of Australia will take action against them. About 200 Muslims, most of whom appear to be migrants or foreigners, attended the protest.

But first, the government must need to identify them and the legal action taken by the New South Wales (NSW) police, Mr Bowen said.

"This is just criminal behaviour. Nothing short of that," The Australian quoted the minister who has the power to cancel visas of migrants and visitors who fail the character test.

Politicians led by Prime Minister Julia Gillard condemned the violent protest although she expressed understanding why the video angered followers of the Islam religion. But she also scored the use by demonstrators of children who bandied placards advocating death.

Following the publication of the photo, NSW Premier Barry O'Farrell sought the identity of the placard-bearing child and asked the state Family and Community Services Department to help find the child.

Treasurer Wayne Swan said both the Parliament and Muslim leaders are against such behaviour as well.

"I think all Australian would be sickened by the behaviour that we saw over the weekend. I think we all condemn this behaviour in the strongest possible terms, particularly the use of children to carry offensive placards," ABC quoted Mr Swan.

Security expert Clive Williams warned that Muslim parents risk their children being groomed in extremist anti-Western ideology by bringing their kids to political protests. He said it represents a new challenge to national security agencies.

"The little boy who was handed that sign during the riot probably couldn't even read it. The problem here is much more among young men who might fall under the spell of more charismatic and influential members of the community who want to lead them into trouble, particularly where these young men are unemployed or from a low socio-economic background," The Australian quoted Mr Williams.