Muslim Khan, the Pakistani Taliban's spokesman in neighbouring Swat, accused the government and the army of being stooges of the US.
"They keep violating every agreement and if this goes on, definitely there will be no deal, no ceasefire," Khan said.
"This is not our army, this is not our government. They're worse enemies of Muslims than the Americans. They're US stooges and now it's clear that either we'll be martyred or we'll march forward."
Meanwhile, renewed fighting between troops and Taliban fighters in Buner has virtually derailed the government's February deal with the Taliban that allows them to enforce sharia, or Islamic law, across Malakand division - which includes Swat and Buner - in exchange for peace.
Sohail Rahman, Al Jazeera's correspondent in Islamabad, said it was a "pretty dire situation".
He said the people had no where to go and the government and its agencies were not telling them in which direction to move.
"The social development minister spoke to us [journalists] a little while ago and she was appealing to aid agencies to try and help those people who were leaving the Swat area and Buner with accommodation," Rahman reported.
"People are leaving with literally clothes on their backs and what few possessions they can carry heading to areas where a makeshift camp has been established."
The February pact had alarmed US officials who worry that Swat will turn into a haven for fighters near Afghanistan, where US and Nato troops are also battling the Taliban.
|The US fears Pakistan is losing the fight
against al-Qaeda and Taliban [EPA]
US officials have also accused the Pakistani government of "abdicating" to the Taliban.
Asif Ali Zadari, Pakistan's president, will be meeting Barack Obama, his US counterpart, in Washington on Wednesday and he is expected to ask him for more support in the fight against the Taliban.
But also on the agenda will be Washington's concern about the security of Pakistan's nuclear arsenal, and America's fear that it is losing the war against the Taliban and al-Qaeda.
On Saturday, the NWFP government announced the formation of an Islamic appeal court, or "Dar-ul-Qaza", saying that the court's establishment would put the onus on the fighters to lay down their weapons.
The creation of the court was among the demands made by Tehrik Nifaz Shariat-e-Muhammadi, a group led by Sufi Muhammad, an influential local religious leader who mediated the deal between the government and the Taliban.
'Agreement in tatters'
But it has done little to stop the violence. On Sunday, two government workers were killed by suspected Taliban fighters.
"There has been a war of words since the announcement ... by provincial government that they were going to implement an Islamic court as per agreement ... and the Taliban factions, led by Sufi Muhammad, [complained they] were not contacted," said Rahman.
"The agreement is in tatters. If the Taliban is out on the streets you can say those agreements are dead and buried.
"There is now more pressure on the military to go in and clean it up if they can," he said.