The young Rovers, who hadn't played a competitive fixture for two-and-a-half weeks, couldn't follow up their 4-1 win over Magpies back in December.
There was a hint of rustiness as the Rovers side, featuring four Under-16s, started slowly and immediately paid the price. Newcastle's Greg Olley taking advantage of a defensive lapse to open the scoring after just six minutes.
Rovers looked to hit back, Sam Joel going close with a shot from the edge of the box, but it was the home side who grabbed the all-important second just before the break through Tom Heardman.
The second half saw Rovers build up a head of steam, Joel denied by a fantastic save from Freddie Woodman, whilst other opportunities went begging.
But Rovers kept plugging away and on 82 minutes they did manage to grab a goal their play deserved, Luke Wall applying the finishing touch after more good work from Joel.
Rovers pressed for an equaliser but unfortunately ran out of time.
"To be fair to the lads it was 2-1 against a quite experienced Newcastle United team," said coach David Lowe.
"But from our point of view it is really good because we are giving a lot of lads a taste of youth team football which can only be good for their development.
"Yes we'll get the odd day like this but we had only one Under-18 lad playing, the rest were Under-17 and Under-16. So it is brilliant for them."
ROVERS: Beauchamp, Nyambe, Doyle, Edgar, Platt (sub Scott 46 mins), Hardcastle (sub Edo 80 mins), Green, Tanner, Wall, Joel, Cham (sub Callaway 85 mins).
Subs not used: Williams.