I might look at top (sort with capital-M) and see if something's eating a lot of memory.
 
If you're near the point where swap-out occurs, it may not be cacheing the apps, so they don't load as fast as they otherwise would the second time.