That is the opinion of former Arsenal attacking midfielder Paul Merson.
Emery has had a mixed start since replacing Arsene Wenger as the Gunners’ head coach last summer.
Arsenal are 12 points better off in the Premier League than they were at this point last season.
However, they still find themselves fifth in the table and in a battle to qualify for the Champions League.
Arsenal’s Europa League life hangs in the balance after losing 3-1 at Rennes on Thursday in the first leg of their last-16 tie.
Emery signed five players in his first window at the club but was not able to make any permanent signings in January, with Denis Suarez the only new face coming in on loan from Barcelona.
Merson is a fan of the former Sevilla and Paris Saint-Germain boss but says he can only be judged when he sorts out the defence.
And he reckons Emery could quit Arsenal if the next two transfer windows do not go to plan.
“I like him, but he has to sort out the defence,” Merson said on talkSPORT.
“If he gets that sorted in this window or in the next two windows, then he’ll be judged.
“Arsene Wenger always used to say one thing, and a lot of managers, you’re only as good as your players, it doesn’t matter who you are.
“You don’t think Pep Guardiola’s going down to do the job Sol Campbell’s doing and he’s going to play the Man City way down there.
“You’re only as good as your players.
“So for me I think he needs two windows and then he’ll be judged.
“Then after that I think he’ll either move on and think ‘this weren’t what it said on the tin’.”
Arsenal are next in action on Sunday when they host top-four rivals Manchester United.