robertdot.org http://robertdot.org The Complete Robertdot Blog Feed. en-us Sat, 12 Feb 2005 10:02:52 GMT Custom script based on LiveJournal RSS feed http://robertdot.org/2005/02/12/web-spiders-changing-user-agents.html Sat, 12 Feb 2005 10:02:52 GMT Web Spiders Changing User Agents http://robertdot.org/2005/02/12/web-spiders-changing-user-agents.html Robert <rss@robertdot.org> Tags: , , ,

Over the past few weeks, some of the major spiders / crawlers / bots / robots / whatever you call them have been changing their user agent strings.

Continue Reading "Web Spiders Changing User Agents" on Robertdot …

]]> http://robertdot.org/2005/02/12/web-spiders-changing-user-agents.html http://robertdot.org/2005/01/15/google-indexing-and-mod-rewrite.html Sat, 15 Jan 2005 07:01:23 GMT Google Indexing And Mod_Rewrite http://robertdot.org/2005/01/15/google-indexing-and-mod-rewrite.html Robert <rss@robertdot.org> Tags: , ,

I've been having problems with Google's index not updating fast enough. If you search for something that was on the front page yesterday, and I've posted something new, you don't see it ('cause it is somewhere else).

Continue Reading "Google Indexing And Mod_Rewrite" on Robertdot …

]]> http://robertdot.org/2005/01/15/google-indexing-and-mod-rewrite.html