This, according to three South Korean fishermen who risked their lives to flee the regime three decades after being abducted.
By speaking out, however, the three continue to put their own lives at risk, as well as the lives of their wives, children and friends they had to leave behind in North Korea. But each of them say it is their duty to tell the world what is truly happening inside the world's most secretive state.
With a nuclear weapons programme and a tightly closed society, some in the West argue it is also the most dangerous.
"The top ranks of the military believe very strongly in Kim and will protect the regime, but the ordinary people are saying things about him behind his back," said Lee Jae Keyn.
His trawler was seized by a North Korean gunboat in April 1970 and he was forced to spend the next 30 years north of the 38th parallel.
"They're very dissatisfied with the regime and, if the leadership believes its grip on power is beginning to slip and starts to turn on the people, they will definitely rise up and attack the military at the local level," said Lee.
Lee's trawler was seized by a
North Korean gunboat
"There are 1.2 million people in the North Korean armed forces who will fight for Kim Jong Il, but the people won't," he said.
Lee, 65, recently visited Tokyo with Kim Byeong Do, 51, and Jin Jeng Pal, 63, both of whom were abducted by North Korean patrol boats in separate incidents more than a quarter of a century ago.
Lee and Kim escaped over the border into China in July 2000, while Jin managed to follow in their footsteps in February the following year.
"The purpose of our visit to Japan is to tell the world about the evil deeds of Kim Jong Il," said Choi Sung Yong, who heads a group that helps South Koreans escape from the North.
Choi helped both Jin and Kim escape into China by sending volunteers across the Chinese border into North Korea to assist them.
All the volunteers are aware of their likely fate should they be detained, but believe the reunions they have witnessed between families that have not seen each other for three decades is worth the high risk.
North Koreans are disillusioned with a government that allowed hundreds of thousands of its 22 million people to starve to death in the mid-1990s, and they know that just one bad harvest will leave them in the same situation again. Even today, there is widespread hunger outside Pyongyang's power circles.
"Two million starving people is a clear threat to the regime," said Lee. "The leaders believe the army can keep the people under control, and maybe they will have to because the people don't believe in him any more."
Jin's family remains in N Korea
By speaking out, Lee is aware that friends, his wife's family and everyone who knew him when he was forced to train spies before they were sent to South Korea could be in danger.
And while he managed to escape with his wife and son, swimming across the Tumen River, his fellow escapees were not so lucky.
Jin's wife, two daughters and a son are still in North Korea, although his oldest son managed to escape last year, while Kim had to leave his wife and two sons behind.
"It will be a problem for my family because I managed to escape," Kim said, slowly turning a glass ashtray in his hands. "They will have been having a very hard time since I left."
According to human rights groups, people who criticise the regime in North Korea, along with families and friends, often end up in gulags.
"From the outside, it might seem that the people support the leadership, but in their hearts they don't trust him at all and don't believe that the country can continue like this for very long," said Jin, who underwent six months of "socialist retraining" after his capture.
"It is my hope that something will happen so that we can be reunited as one nation as soon as possible; that would be the best thing for the people of North Korea.
Choi helped Jin and Kim escape
"I decided to leave when I had an opportunity because I felt that I was getting nearer to death and I wanted to return home to see my brothers before that day came," he said.
Unfortunately, the trickle of information that leaves North Korea's tightly sealed borders suggests that his family is being closely watched by the authorities to prevent them from trying to follow him to freedom.