An 85th minute penalty by Asamoah Gyan gave Ghana - and Africa - their first victory of the World Cup 2010 finals.
A 1-0 win over Serbia on Sunday brought a true flavour of the continent to the tournament.
The late winner for Ghana sent their fans, decked out in their striking national colours of green, yellow and red, into rapture and will significantly aid the team's chances of progressing into the next round.
"This win gives us a boost of confidence for the next matches. But we are going to take it one at a time," said midfielder Dede Ayew.
Ghana were backed by local South Africans, sounding vuvuzela trumpets in a coordinated rhythmic fashion, rather than the drone that has been heard at some of the earlier games.
Ghana's John Pantsil, who caused controversy at the last World Cup by celebrating a win by waving the Israeli flag, was the first to race to the crowd at the final whistle and grab a giant Ghana flag.
He sprinted around the field while the crowd in the stands tumbled around in delight and his team mates danced in the centre circle.
The memorable victory celebration came after a largely dull game which only came alive after Serbia were reduced to 10 men by the dismissal of Alekasandar Lukovic for a second yellow card in the 74th minute.