Bury cemented their League One status in style with two goals from Mike Grella, taking his scoring record to four in three games, and making it four wins in five games for the Shakers.
They had to overcome a shaky start which saw Alan Judge show off his skills within the first minute, setting up Lee Hughes in front of goal, but he headed wide.
Bury went on to take a first half lead with a stunner of a goal from David Worrall, before surviving a second half equaliser and stretching their lead to 3-1. A second yellow card for Andria Jones did sour the result somewhat, but after County made it 3-2, substitute Mark Carrington ran from his own half to take the ball forward and past Stuart Nelson in added time, giving Bury the resounding win.
Straight from the kick off, a swirling cross from Alan Judge on the right found the head of Lee Hughes in front of goal but he somehow headed wide. At the other end, Shaun Harrad sprinted clear to latch onto a forward ball from Steven Schumacher but Stuart Nelson in the County goal got down well to take the ball from his feet.
Moments later and Hughes was back looking for another opening - he shot from the left of the box but Jonathan Bond had it covered, palming the ball in front of him to be cleared.
A corner from Peter Sweeney on 8 minutes found Nathan Clarke at the near post, but he was dispossessed before he could control the ball. A foul on Harrad gave Bury a free kick on the edge of the box moments later, but Harrad blasted the ball into the Notts County" target="_blank">Notts County wall.
After much authority-stamping from either side, it was Bury who came closest to breaking the deadlock on 41 minutes - a long throw from Nathan Clarke on the left found Efe Sodje towering above the County backline, but he headed over the bar.
GOAL! The Shakers did indeed start the scoring moments later, courtesy of a gorgeous finish from David Worrall. A through ball from Mike Grella picked him out and, running onside, he took the goal with style, shooting with power and precision from the right of the box, leaving Nelson with no chance.
Notts County" target="_blank">Notts County 0 Bury 1
Added time saw County try a late attack, as a curling free kick from Alan Sheehan found Liam Chilvers in front of goal, but he put the ball over the bar.
Half time - Notts County" target="_blank">Notts County 0 Bury 1
Notts County" target="_blank">Notts County double substitution at half time - Alan Sheehan replaced by Lloyd Sam, Daniel Bogdanovic replaced by Dele Adebola
GOAL! The home side were back in the match soon after the restart with a lucky finish for Lee Hughes. He got a touch to the ball in front of goal with what looked like the back of his foot, wrong-footing Bond.
Notts County" target="_blank">Notts County 1 Bury 1
GOAL! Bury restored their lead minutes later, thanks to another cheeky goal for Mike Grella's tally. A forward pass from Schumacher picked out the on-running Giles Coke, and he picked out Grella on the left of the box who calmly chipped Nelson.
Notts County" target="_blank">Notts County 1 Bury 2
Judge will wonder how he didn't score on 52 minutes - Bond dropped the ball from a cross, leaving Clarke to make a goal line clearance from a Lee Hughes shot, but the ball only went as far as Judge just inside the box. He eyed up the near post for a shot, but put it wide.
Notts County" target="_blank">Notts County substitution on 58 minutes - Liam Chilvers replaced by Mike Edwards
Bury yellow card on 61 minutes - Andrai Jones
Lee Hughes had a great chance to make it two for County and himself on 65 minutes - a mistake from Coke saw Hughes break free with the ball, but his shot from the left of the box went wide of the far post.
GOAL! Grella got his second and Bury's third goal of the afternoon on 67 minutes - Coke used some fancy footwork on the left, outwitting his marker, before passing to Grella in the middle who put the ball past Nelson for the second time in the game, albeit taking a deflection en route.
Notts County" target="_blank">Notts County 1 Bury 3
Clarke stepped in to clear the ball from in front of Adebola as he waited to pull the trigger in front of goal on 74 minutes, maintaining Bury's two goal cushion.
GOAL! Substitute Mark Edwards towered above the Bury boys on 79 minutes to head the home side back into the game from a Judge corner.
Notts County" target="_blank">Notts County 2 Bury 3
Bury substitution on 80 minutes - Shaun Harrad replaced by Andy Bishop
Bury red card on 82 minutes - Andrai Jones (second bookable offence)
Bury yellow card on 82 minutes - Peter Sweeney
County continued to pile on the pressure once Bury were down to ten men, and Adebola headed wide of the far post with six minutes left on the clock.
Bury substitution on 84 minutes - Peter Sweeney replaced by Mark Hughes
Bury substitution on 85 minutes - Mike Grella replaced by Mark Carrington
A goal line scrap with seconds of normal time remaining saw Bury let off the hook, but with five minutes of added time, the Shakers were well and truly under pressure.
GOAL! The pressure soon lifted after substitute Mark Carrington ran from his own half with the ball before finishing coolly past Nelson to chalk up Bury's fourth goal in the third minute of added time.
Notts County" target="_blank">Notts County 2 Bury 4
Added time was soon over following an amazing result for the Shakers. They had a shaky start but played some good football to overcome a side challenging for the play offs, cementing their League One status in the process.
Full time - Notts County" target="_blank">Notts County 2 Bury 4
Attendance - 6,432 (464 visitors)