For the small sites I've noticed I can only see my sites on page 1 in a search immediately following a referral from a SE. Seems to me the spiders just don't have very long attention spans.
No matter though. It's nice knowing spiders are actually munching on my sites, even if their interest in me is fleeting, at best.