A double by Serhiy Nazarenko saw Ukraine come from a goal down to claim victory over Kazakhstan as they moved level on points with second-placed Croatia.
The visitors, who entered the game with just one win in their Group Six campaign, took the lead after 19 minutes through Tanat Nuserbayev before Nazarenko levelled after 33 minutes with the winner arriving two minutes after half-time.
After an attacking opening from both sides, it was the visitors who went ahead when Zhambyl Kukeyev went past Vyacheslav Shevchuk before shooting.
Defender Andriy Rusol attempted a header out but the ball hit Nuserbayev who had a simple job slotting home.
Ukraine almost hit back four minutes later when Ruslan Rotan hit the bar while Nazarenko was closed down as he attempted to shoot.
However, the hosts were level in the 34th minute when Nazarenko scored from a free-kick with Kazakh keeper Alexandr Mokin left with little chance.
Mokin, though, saved from Rotan's free-kick minutes later and the visitors missed a great chance to take the lead on the stroke of half-time when home keeper Stanislav Bogush parried the ball to the feet of Vyacheslav Erbes but the Kazakh striker sent his shot over the bar.
Kazakhstan will have rued their failure to score as they were 2-1 down two minutes after the break when Nazarenko slotted home a precise shot after Artem Milevskiy's pass.
The home team began to dominate but were unable to extend their lead, Rotan prominent in their attack.
Just six minutes from time, Kazakhstan nearly drew level when substitute Yevgeniy Averchenko sent in a shot but the ball went over the bar.
The hosts could have wrapped it up with three minutes to go when Yevhen Seleznyov had a chance but missed an open goal.