There were also conflicting reports on casualties.
Radio Rwanda reported that 23 people were killed, but the Reuters news agency reported Mary Gahonzire, the deputy police chief, as saying: "Twenty one people are so far confirmed dead in the earthquake. Two hundred have serious injuries."
Ten people were killed "straight away when a church collapsed" in the Rusizi district of Western Province, the radio said.
Thirteen other people were killed in Rusizi and Nyamesheke districts and some 250 wounded were transported to various regional hospitals, the radio said.