Goldstone said the attacks on him had become personal and that he believed most critics had not even read the report.
"I've no doubt, many of the critics - the overwhelmingly majority of critics - have not read the report," he said.
"And, you know, what proves that, I think, is that the level of criticism does not go to the substance of the report.
"There still have not been responses to the really serious allegations that are made. People generally don't like to be accused of criminal activity.
"So it didn't surprise me that there was criticism, even strong criticism, and it has come from both sides."
Goldstone said he regretted the "extremes from which some of the criticism has come and the fact that it has been so personal".
The remarks follow US criticism of the report, which it says is one-sided.
The US was among countries which voted against a UN human rights council resolution on the report passed in Geneva by 25 votes to six with 11 countries abstaining.
But other UN diplomats have vowed to support Goldstone.
Riyad Mansour, the Palestinian ambassador to the UN, has said that he expects the Goldstone Report to be given serious consideration at the UN Security Council.
"We know that there are certain members in the Security Council that prefer that the [UN] council on human rights and the [UN] General Assembly deal with this issue [and] not the Security Council. But we will not take "no" from anyone.
"We will contact all members of the Security Council and we expect the Security Council to shoulder its responsibilities with regard to the implementation of the recommendations in the report addressed to the Security Council."
The Goldstone report also accuses Hamas, the Palestinian faction in control of Gaza, of war crime violations, but it reserved most of its criticism for Israel.
Israel's three-week offensive on Gaza between last December and January killed about 1,400 Palestinians, a majority of them women and children, and 13 Israelis.
Israel said it attacked the coastal territory to stop Hamas fighters firing rockets into southern Israel.