Wayne Rooney returned to give Manchester United manager David Moyes his maiden win at Old Trafford as the champions beat Crystal Palace 2-0, while Jose Mourinho suffered the first English Premier League defeat of his second spell at Chelsea.
Rooney had missed United's defeat at Liverpool and England's World Cup qualifiers against Moldova and Ukraine after suffering a gashed head in a training ground collision with team-mate Phil Jones.
But, wearing a black headband to protect the damaged area, Rooney marked his return to action with his first goal of the season in the 81st minute.
Robin van Persie had struck from the spot to give United the lead in first-half stoppage-time after Palace's South African midfielder Kagisho Dikgacoi was sent off for fouling Ashley Young.
Moyes sent on Belgian midfielder Marouane Fellaini for his United debut in the 61st minute following his $43.7 million move from Everton on transfer deadline day.
With Alex Ferguson watching from the stands for the first time since his retirement, United sealed their first win in three league games - and Moyes's first on home soil since his arrival as Ferguson's successor - thanks to Rooney's fine free-kick.
"He tired a bit in the second half but I thought he was great in everything he did," Moyes said of Rooney.
"I wanted him to get 90 minutes under his belt, which is important with the busy week we have coming up."
Saturday 15 September
Aston Villa 1-2 Newcastle
Everton 1-0 Chelsea
Fulham 1-1 West Brom
Hull City 1-1 Cardiff City
Man United 2-0 C Palace
Stoke City 0-0 Man City
Sunderland 1-3 Arsenal
Tottenham 2-0 Norwich City
Sunday 15 September
Southampton v West Ham
Monday 16 September
Swansea v Liverpool
Meanwhile, Mourinho's Chelsea, who taken seven points in his first three matches, paid the price for failing to convert their early chances as Steven Naismith's goal in first half stoppage-time gave Everton a 1-0 win - their first under new boss Roberto Martinez - at Goodison Park.
Naismith, who was celebrating his 27th birthday, headed in after Chelsea debutant Samuel Eto'o and winger Andre Schurrle both squandered golden opportunities.
Mourinho said: "We didn't deserve to lose because we were the best team. But on the other hand we had 21 shots, some of them easy shots, and we didn't score, so we can't complain."
At Sunderland, Mesut Ozil, Arsenal's club record signing, made an instant impact during his 79-minute appearance, while team-mate Aaron Ramsey continued his fine start to the campaign in the Gunners' 3-1 victory.
Ozil, signed from Real Madrid on transfer deadline day for £42 million, didn't take long to show his class as the Germany midfielder produced a brilliant touch to control a long ball and then squared for Olivier Giroud, who made no mistake with a cool finish in the 11th minute.
Sunderland drew level when Laurent Koscielny needlessly fouled Adam Johnson in the penalty area and Craig Gardner drove home the resulting spot-kick in the 48th minute.
But Ramsey restored Arsenal's advantage in the 67th minute with a superb volley and the Wales midfielder wrapped up his side's third league win of the season as he finished off a slick move nine minutes later.
The win put Arsenal on top of the table on goal difference.
Ramsey was quick to hail Ozil's impact, saying: "You've seen what he is all about, slipping those balls in, he has one of highest assist-rates in Europe and he is going to create a lot of opportunities for us."
Tottenham started the post-Gareth Bale era with a 2-0 win against Norwich at White Hart Lane.
Bale joined Real Madrid just before the transfer deadline earlier this month but the Welsh winger's move doesn't seem to have unsettled Andre Villas-Boas's team, who have won three of their four matches this term.
They were ahead when Danish winger Christian Eriksen, signed from Ajax to fill the gap left by Bale, slid the ball perfectly into the path of Gylfi Sigurdsson, who hammered home in the 28th minute.
Iceland midfielder Sigurdsson killed off Norwich with his second goal, from Paulinho's cross, four minutes after half-time.
Stoke manager Mark Hughes frustrated his former club as Manchester City were forced to settle for a 0-0 draw at the Britannia Stadium.
Yoan Gouffran was Newcastle's star as the Magpies won 2-1 at Aston Villa.
Alan Pardew's team moved in front when Hatem Ben Arfa lashed home in the 18th minute.
Christian Benteke brought Villa level in the 67th minute. But Newcastle took the points thanks to French midfielder Gouffran six minutes later.
Hull and Cardiff shared a 1-1 draw in a clash between the two clubs who won automatic promotion from the Championship last season.
Steve Sidwell's 22nd minute strike gave Fulham the lead at Craven Cottage but West Bromwich Albion rescued a 1-1 draw when Gareth McAuley netted in the 90th minute.