Car Sputtering/Hesitating
 

I have an 2001 civic that sputters at certain rpms when driving it seems. It seems to only happen in 4th gear around 2500 rpm and stops when i get to 5th around 3000. After driving at 65 mph for a couple seconds the sputtering completly goes away, even if i make a complete stop and go back to the certain rpms where it happens, seems to work fine when it warms up. The sputtering is not terrible and it is still drivable.

I was thinking about changing the fuel filter or looking at cleaning out the throttle body. I have already changed the spark plugs to new NGK plugs and am wondering what would be the next step.

Thanks!