Crawling and Indexing

Another SEOmoz Whiteboard Friday..

Christopher is the founder of iMod - Most of his time is spent building websites and pushing the limits with Search Engine Optimization. You can follow him on Twitter @ChristopherM

Enjoy this post? Please tell a friend:

8 Comments on "Crawling and Indexing"

  1. Gavin says:

    Thanks Chris!

    That was most interesting.. certainly opened my mind as far as SEO is concened.

    Look forward to the next episode.

    G.

  2. Chris M says:

    I started to feel that it’s really important to educate everyone. And although the video isn’t by myself, it is by the best of the best, which means we know it’s a reliable source :)

  3. I ping the search engines with my sitemap, as there’s no RSS feed. Is that wrong? I think it works though. Launched a client’s site a month ago – went straight to page one for it’s top 2 search phrases and has stayed there ever since.

  4. Chris M says:

    What do you mean by pinging the search engines with the sitemap? You mean that you’re sending the sitemap to the search engines?

  5. Eh… Yeah. That is what I mean. Sending the sitemap to the crawler/search engine, instead of registering/submitting the site to the search engine and waiting for it to come and crawl. I get brand new websites into Google in 24 – 36 hours like that. If you “submit” your site with Google, it takes weeks.

    Here is an example, although it’s never the same for every search engine:

    http://api.moreover.com/ping?u=http%3A%2F%2Fwww.vj-elite.co.za/sitemap.xml

    Like I said – not sure if I am allowed to do it like that, but it works. The VJ site was in Google within 26 hours after I pinged it.

  6. Chris M says:

    Nah, you’re definitely allowed to use ping services, just make sure you suffle IP addresses if it’s pinging on a very frequent basis :)

  7. That’s the thing: I do it once for each site. Some I do again after I’ve updated it. I don’t offer SEO as a service to my clients, although I do design with that in mind. So I don’t throw a lot of traffic their way in that regard. You sounded confused with me pinging them the sitemap? Isn’t this common practice?

  8. Chris M says:

    You phrased it in a manner which made me think you had an automatic script, which pinged on a frequency, such as a cron job :)

Got something to say? Go for it!