I’m not kidding about this – I recently came across a website that was blocking a user agent from a very well known search engine. No one at the company had any idea of the situation, and this particular situation had been costing them a ton of traffic over weeks and weeks.
Time to get the honesty box out: When was the last time you switched user agents? Checked a 304 not modified response? Made sure your canonical www redirect was working correctly? Some things are so easily missed in todays “out of the box” code world. Here are 5 quick checks that are so easily missed, but can save hours of head scratching! (more…)