A seven minute blast from the visitors saw Rovers go three down and effectively out of the competition midway through the 2nd half
There was a late fightback with two goals from Rovers but it was too little too late.
David Connolly (2) and Michail Antonio scored for Southampton. Darryl Duffy and an injury time Jeff Hughes penalty registered the goals for Rovers.