Albion ran out 2-1 winners in an ill-disciplined affair at Elgin as both sides ended the game with 10 men.
The visitors took the lead on the stroke of half-time when Patrick Walker produced a fine finish high into the top corner following some good work by David Crawford.
And they doubled the advantage from the penalty spot eight minutes after the restart. Crawford this time stepped up to take and coolly slotted the ball past Raymond Jellema.
However, they were reduced to 10 men after 69 minutes when goalkeeper Neil Parry was dismissed for serious foul play.
But City themselves were soon a man light when Sean Crighton was shown a second yellow, before Craig Gunn grabbed a late consolation from 12 yards.