Lee Clark named an unchanged starting eleven for the first time this season, though made changes to the bench with Mihai Dobre and Callum Reilly named in place of Tsun Dai and Joe Skarz.
Bury began the game brightly and created the first half chance of the afternoon, a great run from Harry Bunn down the flank saw him play a quick one two with Ryan Lowe, before he continued his run across the face of the Millers area, but unable to find the space for a shot, he eventually lost his momentum and allowed the home defence to hook the ball clear.
Rotherham’s first chance came on four minutes with Will Vaulks connecting with a cross from Taylor. His first-time shot flew through the Shaker's defence, though fortunately straight at keeper Joe Murphy, who collected and held the ball. Moments later, another curling ball into the box from Jon Taylor saw Nathan Cameron stretching to somehow connect with the ball and hook it over the bar from the edge of the box for a Rotherham corner.
Joe Murphy kept the Shakers in the game twice within the first ten minutes of the game starting, the first when a close-range drive from Moore brought an instant reaction from Murphy as he beat the ball away with the palm of his hands. Moments later, and with Rotherham building momentum, the ball fell to Williams on the edge of the box. His venomous drive at goal brought a stunning save from the Shaker's custodian as he somehow dived, twisted and palmed the ball over the bar.
Jermaine Beckford tested debutant keeper Rodak on 15 minutes with a crisp shot from the edge of the box, though in truth, Rodak saw the shot coming and dived smartly to smother the shot.
The home side took the lead on 19 minutes when a long diagonal ball fell to Moore, who suddenly found the time and space to control it within the Shakers area before calmly slotting it across Murphy and into the opposite corner.
Last weekend we saw signs of Harry Bunn’s attacking prowess with a few raids down the wing with the ball. He carried on where he left off this weekend with another good run on 28 minutes. Taking the ball into the corner, beating two defenders in the process, but when the ball finally came into the box, the only coloured shirts on hand were red shirts, who easily cleared.
Bury got back in the game on 33 minutes. Some great link up play between Edwards and Ryan Lowe in the corner, eventually saw the Shakers player coach whip a delightful cross into the box that Jermaine Beckford buried into the bottom corner with a rasping header.
Half time duly arrived though it was to be just as entertaining as it later emerged that manager Lee Clark had been sent to the stands for an altercation with referee Chris Sarginson during the break. An event that Lee Clark later apologised for.
The home side went back in front on 53 minutes when Jon Taylor delivered another stunning ball into the box. Kieffer Moore rose above all to firmly plant his head through the ball and into the back of the goal.
A Rotherham free kick on 62 minutes almost produced another goal. Jon Taylor took the dead ball from a very acute angle in the corner and drove a ferocious shot, at goal, that saw Joe Murphy dive as the ball flew across his goal at pace, but drifted out of play on the far side for a goal kick.
Bury pressed for a while and applied some pressure on the home side and on 67 minutes got their reward. A great delivery from Bunn was flicked on by Beckford to the far post, where Nathan Cameron throw his body at the ball and connected with a stunning diving header to ram the ball home to make it all square.
Cameron showed his passion again moments later when he rose to head a ball clear, beating Taylor to the header. As he collapsed on the floor from the challenge, Moore took a swipe at the ball and sent a goal bound effort away at pace. Cameron threw his body at the chance to block the effort, whilst he was dragging himself back to his feet.
Rotherham won the game with less than 90 seconds on the clock. A ball across the box found substitute Towell, he took one touch before lashing an unstoppable drive into the bottom corner for their third goal of the afternoon. Despite five minutes of additional time, the Shakers were unable to test keeper Rodak and the game finished with a 3-2 defeat.
Bury: Joe Murphy, Greg Leigh, Jermaine Beckford, Jordan Williams, Phil Edwards, Josh Laurent, Alex Whitmore, Nathan Cameron, Rohan Ince, Harry Bunn, Ryan Lowe
Subs: Leo Fasan, Chris Maguire, Callum Reilly, Tom Aldred, Mihai Dobre, Ryan Cooney, Michael Smith
Rotherham United: Marek Rodak, Will Vaulks, Richard Wood, Lee Frecklington, Jon Taylor, Darren Potter, Ben Purrington, Michael Ihiekwe, Ryan Williams, Keiffer Moore, Shaun Cummings
Subs: Richard O'Donnell, Joe Mattock, Anthony Forde, David Ball, Richie Towell, Jerry Yates, Joe Newell
Gate: 7,848 (574)
Referee: C Sarginson
Asst: H Byrne
Asst: R Cheosiaua
4th: D Ford