Berwick booked their place in the second round of the Petrofac Training Challenge Cup after beating Queen's Park 4-3 on penalties.
The visitors broke the deadlock after just three minutes when Darren Lavery rifled in from the edge of the penalty area.
The Spiders pushed for an equaliser and it finally came in the 33rd minute when new boy Ross McPherson latched onto Kevin Fotheringham's cross to head home from close range.
Both teams had chances to win it before the referee blew the full-time whistle but they failed to make them count and the game entered extra time.
The hosts were reduced to 10 men in the first minute of extra time when Shaun Fraser was sent off for picking up his second yellow card before Darren Miller almost put Queen's Park in front when he unleashed a brilliant right-footed strike from the edge of the box, only for his effort to clatter the bar and bounce down onto the line.
Berwick then hit the post five minutes later but neither side was able to find a winner and the match was to be decided by penalties.
Queen's Park duo Vincent Berry and Tony Quinn failed to convert their spot-kicks, handing victory to Colin Cameron's side.