The web is full of spiders
- May 25, 2012
Since I rebuilt my web site, I've been using some interesting statistics tools that show information about visitors to my web site. Back in the day, pretty much the only traffic you'd see was real people using web browsers to actually look at your site. These days, the amount of traffic coming from spiders (automated "bots" that crawl the web indexing its pages) is phenomenal. Sadly, these days I get about as much traffic from spiders as I do from actual people. In addition to the spider-bots, there's also a lot of traffic from other kinds of malicious bots whose only job is to crawl the web looking...
Read more
Recent Comments