Matt Marshall over at SiliconBeat makes a point that is definitely worth making — and one that apparently has to be made over and over again before people get it — which is that Web analytics is (to put it mildly) an inexact science. In fact, looking at the Web-traffic numbers reported by Hitwise, Alexa, Nielsen and Comscore makes the weather-forecasting business look precise and infallible. This is an issue that has come up in the past with MySpace and its growth (as I discussed here) and has now come up again with respect to del.icio.us.
The dancing around in Marshall Kirkpatrick’s recent post at TechCrunch is almost comical, although to be fair at least Marshall is trying to get the story straight. He notes that Mike Arrington wrote about del.icio.us awhile back and was critical because its traffic was stagnating, but then had a chat with creator Josh Schachter and some Yahoo folks (I’m sure no bright lights or sleep deprivation was involved — Yahoo is much more subtle) and now TechCrunch is convinced by a Hitwise report that traffic has doubled.
Stagnating, doubling — tomato, tomahto, right? To his credit, Marshall goes out of his way to note that while Hitwise is a “respected” traffic analysis firm, numbers are all over the map — and he links to the other Marshall’s critique of the field. The simple fact is that Hitwise, Comscore, Nielsen and Alexa all use different methodologies (a good description here) and as a result they are not just talking about apples and oranges, they are talking about apples and oranges and plums and peaches.
When you’re trying to make apple sauce, that’s kind of a problem — and unfortunately all it means is that websites can use whatever data they want to tell whatever story they want, and various blogs and media will lap it up.