Lee Connell was the Shakers' hero as he gave brave Bury a deserved third victory of the season with a winning goal ten minutes from time.
The experienced defender, introduced into the action at the death, scored with his first touch, side-footing home from inside the six-yard box after Ben Thornley - making his debut for the Shakers - had seen a powerful drive spilled by Huddersfield keeper Ian Gray.
It was just rewards for Andy Preece's side who had much of the early play and took the lead through Danny Swailes in the 24th minute.
The towering defender rose above the visitor's defence to nod home a Thornley cross at the back post.
But the home team were made to work hard for their victory when Paul Scott levelled matters with a well-taken header from a Tony Carss corner in the 73rd minute.
However, hang on Bury did, and with it made sure they secured three valuable points in the race to make the play-offs again this year.
Former Bury hitman Jon Newby lined-up for Huddersfield on his first return to Gigg Lane.
But the Warrington-born centre-forward had a quiet game and it was midfielder Carss who had the best chances for Peter Jaskson's team, twice going close with long-range efforts in the first-half and then one after the interval.
It wasn't enough though for the Yorkshire side who were reduced to ten men in the 75th minute when Efe Sodje, the former Crewe Alexandra player, was shown red for hauling down Joe O'Neil when clear on goal.
In the early stages Jon Worthington came close to scoring for the visitors with a left-footed shot from the edge of the area, while at the other end David Nugent would have surely have scored if it had not been for a wonderful save from Gray.
Nugent stole the ball of Sodje, who took too much time trying to clear his lines.
But Gray was on hand to block Nugent's shot at his near post and keep his side in the game.
Scott's equalising goal in the 73rd minute gave Jackson's side renewed hope, but Sodje's dismissal and Connell's deft strike at the end sealed matters.