Mmusi Kotane, an ANC delegate, said: "There was a delay. Voting started just after 8am (0600 GMT). The line is moving very slowly."
The vote will be counted manually rather than electronically at the insistence of Zuma supporters, who say they fear rigging by Mbeki.
Many investors are nervous about a Zuma victory, fearing it could tilt South Africa to the left and change Mbeki's conservative policies, which have stoked the economy.
Zuma, who is backed by trade unions and the Communist party, has tried to woo investors and says he will not change economic direction.
The result of the vote among the ANC's 3,900 delegates was expected to be revealed later in the day.
On Monday supporters of the men, formerly allies, staged rallies outside the conference, singing partisan songs and chanting slogans.Zuma lead
If Zuma wins, he will almost certainly also succeed Mbeki as the country's president in 2009 due to the party's electoral dominance.
Mbeki is barred by the country's constitution from seeking a third term as the country's president.
But if he were to remain the ANC leader, he would influence the party's choice for the next president.
Zuma took the lead over Mbeki in branch elections for the ANC presidency, winning the support of five out of the nine ANC provincial branches as well as the backing of the women's league and youth league in a first round of voting before the conference.
The infighting caused deep concern in an organisation that prided itself as presenting a united front during the struggle against apartheid and has ruled virtually unopposed since 1994.
|Rallies for both men were held outside the|
ANC conference in Polokwane [AFP]
"The organisation is going through deep strain," Smuts Ngonyama, ANC spokesman, said.
Nelson Mandela, the 89-year-old former president, who has retired from politics but who is still seen as a unifying figure in the country, also expressed his concern at the divisions in the party.
"It saddens us to see and hear of the nature of the differences currently in the organisation," he said in a message to the delegates distributed by the South Africa Broadcasting Corporation.
"Whatever decision you are to make at this conference, including decisions about leadership positions in the organisation, let the noble history of the ANC guide you," he said.
Zuma is a controversial figure. He was acquitted of rape last year but is still under investigation for corruption.