I don't think its solely a memory issue. Vista is slow at doing simply things for no good reason. Bad coding pure and simple. Its Windows ME II in my opinion.
I installed it on a fresh install of Vista. I'm not noticing anything different either. But the fresh install of Vista seems faster than I remembered it.