"He wants to withdraw," the source said on Friday. "He will oversee the next sitting and then announce his reasons for withdrawing."
Amin's next hearing is on 24 January.
Asked why the Kurdish judge, based in the northern city of Sulaimaniya, wanted to pull out of a trial that has made his face familiar around the world during long days of television coverage, he would say only: "It is too difficult."
The killing of two defence lawyers has already highlighted problems with the process in a country mired in a virtual civil war that pits Saddam's fellow minority Sunni Arabs against a US-backed government run by Shia Muslims and ethnic Kurds intent on hanging a man they say massacred their peoples.
Kidnapping and murder have become commonplace and human rights groups have questioned the wisdom of pushing ahead with a trial in Baghdad rather than an international process in The Hague or elsewhere.
Court officials were not immediately available for comment.
There is already a precedent in the trial, which opened on 19 October, for replacing one of the panel of five judges, so in principle Amin's departure may cause little upset.
"A judge should never be afraid because he defends justice and the law"
But in practice, the resignation of the most visible face of the court outside of the dock may be an embarrassment for the Iraqi government and US officials keen to show the world that Iraqis are capable of giving their former leader a fair trial.
Amin, 48, told Reuters in November that his family worried about him and he had taken on two bodyguards after pressure from friends. But he stressed: "A judge should never be afraid because he defends justice and the law."
Only one other of the five judges on the panel has allowed himself to be seen on camera and many of the witnesses called to testify have spoken behind a screen with their voices distorted to avoid retribution.
After several hearings of crimes against humanity committed against over 140 Shia men from the town of Dujail, Amin was criticised by some observers for allowing Saddam to speak at length, making allegations, including of his maltreatment at American hands.The judge, whose dry wit and courteous manner have been features of the trial since its first day, has rejected the criticism and insisted the defence should have a fair hearing.