My reasons to consider an alternative to Clicky, and Plausible in particular, were varied. Plausible looks nicer. Clicky’s free plan only lets you track one site, I want analytics for this site and for my Context of Agile site. I’d like to have more than 30 days of history for my data. Those last two wishes require a paid plan (regardless if Clicky or Plausible) and Plausible is cheaper than Clicky.
So I got a 30-day trial with Plausible, added its script to my site, while Clicky also kept collecting data. With the trial now over, it’s time to take a look at the data they both collected over the period from 28 November to 27 December 2021. I’ve added some thoughts after each table with data and at the end of this post I’ve added some more general thoughts.
Let’s start with some basic site metrics.
Starting with the first metric, unique visitors, there’s already a significant difference between Clicky and Plausible. The average visit duration is also sobering: few if any of my blog posts can be read in 51 or 81 seconds. My first reaction to the bounce rate was that it was rather high, but then I realized that for a site that’s mostly a blog, it makes sense. Most visitors follow a link to a specific blog post, read it (or skim it, based on the visit duration), and move on.
There’s one stat I didn’t include in the table, because Clicky and Plausible don’t measure it in the same way. Clicky measured 434 actions, of which 90+% should be page views. Plausible counted 525 page views. So also quite a gap there even if we consider all Clicky actions as page views.
Sources and search
Next set of data: where do visitors come from? Are they referred via another site? Or did they find the site via a search engine?
|Ministry of Testing||5||6|
Note: there were some more small sources. I left those out, because I don’t think they add to this analysis.
The first thing that strikes me is the large number of direct visits. Since most of my page views are for specific blog posts, that either means people are typing or copy-pasting the full url to a blog post into their browser, or that people are coming from a source that can’t be tracked. My bet is on the latter.
The other thing that’s interesting about the data is the difference between Clicky and Plausible. Plausible has more direct visitors; Clicky has more referrals. They don’t cancel each other out, however. Both Clicky and Plausible reported 84 referred visitors in total, so the difference is in the counts for the individual source sites.
Finally, testingcurve.wordpress.com is my old Wordpress blog. Apparently some people still find that site first, so perhaps I should do some search engine optimization for this site.
On to search engines:
The theme is probably becoming clear by now: the numbers are different, but there is no clear pattern to the differences.
This theme continues with the countries visitors are from. Plausible has significantly more visitors from the Unites States and the Netherlands, but significantly fewer from China and Canada than Clicky.
Note: I only included countries for which either Clicky or Plausible counted 10 or more visitors.
At this point I started to wonder if the total number of countries matches the total number of visitors. Plausible counted 296 country entries, which matches the number of unique visitors it reports. Clicky counted 293 country entries, which matches the number of visitors it counted, but not the number of unique visitors (273). So it looks like I should not be comparing the numbers the way I am in the table above: Plausible records the country for each unique visitor; Clicky for each visitor.
The data on which pages were visited, is no different from the previous tables. Plausible and Clicky never seem to agree.
|(clj 7) Programming to abstractions with sequence functions||92||111|
|How to run a remote Elephant Carpaccio||53||56|
|Test strategy primer||24||22|
|Two times remote Elephant Carpaccio||20||21|
|Lessons learned after facilitating remote Elephant Carpaccio||14||12|
|(clj 5) Loop and recur, into and conj||7||10|
Note: I only included pages for which either Clicky or Plausible counted 10 or more visitors.
These numbers mostly makes sense to me. The first two are posts I published in the reporting period. The one about remote Elephant Carpaccio links to two post from October about the same topic, so they also show up in the data. My home page and blog page are in 3rd and 4th place. The “Test strategy primer” is from 2019, but I shared it in at least one Slack workspace. Which leaves the bottom two entries, both related to Clojure. I’m not sure why they got those views. I did publish a Clojure blog post in the reporting period, but it links to neither of those two pages.
After all of this I feel like I have more questions than before I started looking into this.
Are Clicky and Plausible reporting the same things? I know they’re not when Clicky labels something as “actions” and Plausible as “page views”, but when they are labeled the same? For countries, one counted unique visitors, while the other counted visitors. Perhaps something similar is going on with other numbers that are labeled the same?
Which brings us to the law2 I referred to in the title:
“A man with a watch knows what time it is. A man with two watches is never sure.”
Someone with two watches can’t escape the question: is one of my watches correct, or if not, at least more correct than the other one? And without a third watch that’s known to be correct, there’s no way to tell. Of course, someone with a single watch has no guarantee that their watch tells time correctly either, but at least they don’t have a second watch constantly reminding them of that fact. The same with site analytics.
I still had to make a decision, though, and decide whether to keep either Clicky or Plausible. I went with Plausible for the reasons I stated at the start of this post. With the next bill date in 12 months, that gives me ample time to reflect on some other questions. How important are site analytics to me? How useful? Is it worth the money I’m paying? And the biggest question: could it be that I sometimes care a bit too much about my site’s numbers?