tag:blogger.com,1999:blog-125341290284114978.post464146753110785843..comments2023-04-23T00:05:10.829-07:00Comments on Guy Ellis' Tech Blog: Inktomi Slurp Confirm 404Guy Ellishttp://www.blogger.com/profile/02574435376236977220noreply@blogger.comBlogger6125tag:blogger.com,1999:blog-125341290284114978.post-65056136306556151762010-10-12T22:35:16.000-07:002010-10-12T22:35:16.000-07:00If you don't want your site indexed by Yahoo t...If you don't want your site indexed by Yahoo then you can block the spider using a directive in the robots.txt file in the root of your site. However, if you want search engine generated traffic I would not suggest that you do this. Instead why don't you setup an email filter that dumps those emails directly into the trash so you don't have to see them?guy ellisnoreply@blogger.comtag:blogger.com,1999:blog-125341290284114978.post-74851300943737641912010-10-12T21:48:09.000-07:002010-10-12T21:48:09.000-07:00This is stupid, I got about 10 of these today. Wha...This is stupid, I got about 10 of these today. What happens if I block the spider to keep my inbox from filling up with notifications about stupid pointless error pages?Angela Quattranonoreply@blogger.comtag:blogger.com,1999:blog-125341290284114978.post-30230582704512345782010-06-21T09:47:54.000-07:002010-06-21T09:47:54.000-07:00Also thanks for this explanation! I found those Sl...Also thanks for this explanation! I found those Slurp Confirm 404s in my log files for my blog and my website for the first time and didn't know what the hell that is.Ronaldnoreply@blogger.comtag:blogger.com,1999:blog-125341290284114978.post-72899892024297139152010-06-17T09:46:38.000-07:002010-06-17T09:46:38.000-07:00Just come across this having checked log files. In...Just come across this having checked log files. InterestingAndy Owennoreply@blogger.comtag:blogger.com,1999:blog-125341290284114978.post-57897529875679555352008-09-16T11:05:31.000-07:002008-09-16T11:05:31.000-07:00Thanks for clearing this up!Thanks for clearing this up!Johnnoreply@blogger.comtag:blogger.com,1999:blog-125341290284114978.post-58081365162116646722008-09-15T22:02:29.000-07:002008-09-15T22:02:29.000-07:00Thank you, I was wondering what this entry was.
I ...Thank you, I was wondering what this entry was.<br />I have seen it a few times in the last week, but it does in fact seem to be the Yahoo spider.Josh Sommersnoreply@blogger.com