jerky start after fueling

I have a problem I hope someone can help me with. I have a 2002 Outback, manual transmission, 4 cyl. engine. It runs very smoothly, except for just after I re-fuel. Upon fueling, I start the car, start driving, and by the time I change to second gear, the engine starts to jerk (almost stalling out it feels like). NO engine lights appear during any of this. The jerkiness continues until I get home and let it cool down. Usually, the next morning, it runs fine again. I thought it might be vapor lock, but I don't think it fits the symptoms.
Any suggestions?