VW Golf Losing Power When Fuel is Below 1/4 Tank. What's the Problem?

I have a 2006 VW Golf 2.0L non-turbo with approximately 48,000 miles on it. When driving on the freeway with 1/4 tank of gas or less, the car will suddenly lose throttle power even though I am still pressing on the gas. The car doesn't turn off or anything that like, it just feels likes someone took their foot off the gas for 2-3 seconds, then power kicks back in. The lower the gas gets, the more frequently this happens. I was thinking it could be that I need to change the fuel filter (hasn't been changed yet) or worst case scenario have to shell out a couple hundred bucks for a new fuel pump, but I don't know jack about cars so any suggestions will really help. Thanks!