Google is on the record as saying that site performance is a key factor in both organic and paid search results. The other search engines might be doing the same thing. So, if your site has always been a little sluggish during peak times, or just a bit pokey all the time, it might be hurting you in ways that you don’t realize. It’s always been true that a slow-loading site can hurt your organic search results. Sites that load more slowly aren’t crawled as often or as deeply.
http://www.searchengineguide.com/mike-moran/google-wants-you-to-speed-up-your-server.php