Like other CAMRA members, I regularly score the cask beer I drink using the National Beer Scoring System (NBSS). This isn’t just for my own convenience: venues generally need to score an average of at least 3.0 on the NBSS to be eligible for inclusion in the Good Beer Guide, while CAMRA’s online pub guide includes filters on NBSS scores (>3.0 and >3.5). So my & other people’s scores are actually contributing to a crowd-sourced measure of quality – of the beer itself, that is, not the range or any other characteristics of the venue. It’s not nothing; once when on holiday I noticed a new appearance in the online list of NBSS 3.0+ pubs, specifically a pub whose beer I’d recently given a 3.5. It had gone again by the time I got home; perhaps I’d been over-generous.
As that example suggests, one scorer’s ratings can vary from another’s (particularly when one scorer’s in a holiday mood and hasn’t had draught Tribute in a while). And, as it also suggests, this doesn’t really matter, as there are generally enough scores for the aggregate not to be affected by individual variations. It won’t even matter if one scorer consistently tends to go high, just as long as there are lower-than-usual scores to balance them out – and if there aren’t any lower-than-usual scores, maybe that just shows a higher rating is deserved. You could even say that it’s good to have a few people who are liberal with their high scores – or with their low scores, for that matter – just to give the averages a nudge, and make sure that beers stand out when they deserve to.
I don’t think the NBSS is entirely fit for purpose, though. To see why not, here are the scoring categories as they’re described on CAMRA’s beer scoring Web page. These descriptions have been reproduced on local and regional CAMRA pages all around the country, although a few branches have taken a different approach – notably Heart of Staffordshire (HoS) CAMRA, whose slightly tongue-in-cheek version of the scoring guidelines I’ll also be quoting.
5. CAMRA say: “Perfect – Probably the best you are ever likely to find. A seasoned drinker will award this score very rarely”. The HoS CAMRA version is similar: “Perfect: I’ve died and gone to heaven. Should rarely be awarded!”.
I’ve never yet awarded a 5; I feel it would signify “the best beer I’ve ever tasted”, and I’m still waiting for that to happen. That word ‘probably’ is interesting, though; I wonder if it’s there to counteract this way of thinking, and to encourage more people to give a 5 when they drink something that could be the best beer ever. CAMRA muddy the waters further when they say, further down the same page, that “a 5 is something given once or twice a year”. I suppose ‘at most’ is implicit; even so, that seems like an awful lot of Best Beers Ever.
4.5. CAMRA say: they don’t say anything, other than that if you can’t decide on a whole-number score you can enter a .5. I don’t really think being undecided is the best way to think of mid-points between scores, particularly not in this case – “this is definitely excellent, but I can’t decide if it’s the best beer ever”? I have given a few 4.5s – five, to be precise; perhaps 1% of my total scores – for beers that I was quite confident were very good indeed; even better than what I think of as a 4. Maybe I should have gone all the way to 5, but surely that would have been too many Best Beers Ever. (Two of the five were in Spoons’, incidentally.)
4. CAMRA say: “4: Very Good – Good Excellent beer in excellent condition” [sic] The HoS CAMRA version reads: “4-4.5: Very good / excellent. Cancel plans for the rest of the day”.
Apart from that “Good Excellent” typo (which really should have been fixed before the page was published), I’m not keen on how the ‘official’ version specifies ‘excellent beer’ as well as ‘excellent condition’. I had a pint of Marston’s Pedigree (brewed by Carlsberg) the other day, which was strikingly good. I was quite happy to score it at 3.5; a pub serving nothing but that beer, in that condition, would be an ornament to the GBG, Carlsberg or no Carlsberg. Yes, even soulless corporate macro shadow-of-its-former-self cask-ale-product swill can score a 3.5. Could it have gone as high as 4 on anothe day? I honestly can’t see why not – but that phrase ‘excellent beer’ would seem to suggest not. I much prefer the HoS version, which captures that “I took a punt on this beer and now I’ve got a new favourite beer” experience that we’ve all probably had (and if we haven’t, we should get out more).
3.5. I’ll come back to that.
3. CAMRA say: “3: Good – Good beer in good form. You may cancel plans to move to the next pub. You want to stay for another pint and may seek out the beer again.” HoS CAMRA are singing from the same hymn sheet: “3-3.5: Above average / Good. I’ll come here again, may cancel plans to move on.”
This, the central point of the scale, is probably the least controversial: 3 means the beer is good enough that you want to drink it again, possibly straight away. And – unless you count the words ‘good beer’ – there’s no requirement that the beer should generally be particularly good; it’s all about the beer you’re drinking at the moment. CAMRA also add that “Most worthy Good Beer Guide pubs tend to score either a 3 or 4 for their beers”, but that’s a self-fulfilling prophecy and hence doesn’t really clarify things.
As for 3.5, I guess that would be “I’m very impressed by this beer and definitely want to drink it again (although I wouldn’t necessarily go all the way to ‘excellent’)”.
2.5. Instead of lumping in the .5 mark with 2, as they did for 3 and 4, HoS CAMRA offer: “2.5 Average. It’s OK but doesn’t tickle your beer-buds”. I’ve got some issues with this, but I’ll deal with them under
2. CAMRA say: “2: Average – Competently kept, drinkable pint but doesn’t inspire in anyway [sic], not worth moving to another pub but you drink the beer without really noticing.” As we’ve just seen, this is more or less exactly how HoS CAMRA defined 2.5; their definition of 2 is, more tersely, “2: Below average. Just drinkable”.
The fact that HoS CAMRA are 0.5 out from the official CAMRA definition isn’t very significant – although personally, for what it’s worth, I lean towards the ‘official’ definition: 2 for ‘mediocre’, 2.5 for ‘better than mediocre but still not actually good’. My issues with these definitions are different. Firstly, CAMRA’s definition raises, once again, the confusion between the quality of the beer in general and the quality of this beer (much of which is down to condition). If anything, the specification of a ‘competently kept’ beer which ‘doesn’t inspire’ suggests that the low mark is coming more from the quality of the beer generally than from the state of this specific example. Along the same lines, further down the page we read, “Bland, uninspiring beers score a 2”. I think this is the wrong way round. I’m not sure what’s meant by ‘competently kept’ – is it a lower bar than ‘well kept’? – but in my experience a beer that’s in good nick is very rarely totally bland and uninspiring. I find it hard to imagine a well-kept pint which I’d want to push down as low as a 2 – even if it was a Pedigree; even if it was a Doom Bar. A beer in mediocre condition will get a 2.5 or a 2 from me all day long, though, even if it’s Bathams Bitter.
Secondly, I hate that word ‘average’: we know that colloquially it means ‘not good’ (‘bang average’), but literally it means ‘the statistical mid-point in a range’, which would imply that there’s just as big a range of beer quality below 2 as above it. Which may be why HoS CAMRA moved the ‘Average’ descriptor to 2.5 – midway between 0 and 5. It’s not really a numerical issue, though, because it’s not just a range of numbers on a scale: it’s a range of pubs, ultimately, ranked in order of beer quality. Are we really saying that half of all pubs serving real ale serve beer that’s ‘average’ – NBSS 2.0 – or worse? If so, what on earth has CAMRA been doing all this time? If we’re not saying that – and I know for a fact that my average beer score is more like 3.5 than 2 or 2.5 – can we stop using the word ‘average’ when what we mean is ‘not very good, of low quality, mediocre’? It’s a great word, ‘mediocre”; I can recommend it. You’ll find lots of uses for it, I promise.
1. CAMRA say: “1: Poor – Beer that is anything from barely drinkable to drinkable with considerable resentment.” Again, HoS CAMRA are thinking along similar lines: “1-1.5. You can only finish it if someone’s holding a gun to your head.” I’m surprised they’ve kept in that old ‘considerable resentment’ line, which to me conjures a slightly ludicrous image of Real Ale TwCognoscenti gritting their teeth and doggedly working their way through borderline-drinkable pints, to do their duty to CAMRA. If it’s not right, take it back, for goodness’ sake. I have to say, I don’t really recognise this category of beer that’s too bad to drink with any enjoyment but not bad enough to take back; I don’t think I’ve ever used a 1. in scoring. (Honesty compels me to admit that I have used 1.5 a few times, most recently for a beer which I decided was on the turn about halfway down the glass – and which, as my suspicions grew, I did in fact drink with considerable (and growing) resentment.)
0.5. HoS CAMRA are at it again with their .5s: “0.5. Vinegar. Send it back or buy some chips to sprinkle it on.” I see what you did there – and I think we probably do need a category for “it’s cask ale but it isn’t drinkable” – but I’m not convinced we need this category and categories 0, 1 and 1.5 as well. In fact there’s a definite case that “I ordered this beer but had to take it back” should be 0. But thereby hangs a tale.
0. CAMRA say: “0: No cask ale available – This can be because the pub never has it or it’s run out.” HoS CAMRA simply say, “0. No cask beer!”. There are several issues here, starting with the fact that 0 is a negative answer to the Yes/No question “Does this pub have any cask ale?”, while everything from 0.5 to 5 is a numerical answer to the quantitative question “how good was this specific beer?”. If 0 is used to refer to the venue as a whole, it becomes meaningless and uninformative when applied to beer quality (as the Curmudgeon pointed out some time ago). If there isn’t any cask beer, what you do with the ‘how good is this cask beer’ question is not ask it at all: you don’t answer it with the lowest possible score.
To see what I’m getting at, imagine an area where pet cats have fallen victim to predatory, leg-biting foxes. But is it actually a widespread problem, or have a few three-legged cats got disproportionate attention? The local vet carries out a survey (possibly written by the Saturday boy) asking one simple question: “How many legs has your cat got?”. What happens to the area’s cat-leg average if households that don’t have a cat answer ‘Zero’? Using ‘0’ to mean ‘no cask ale available’ has just the same problem: a venue that consistently serves cask beer in poor but drinkable condition is very different from one that was serving NBSS 3.5 beer on twelve of the 21 occasions it’s been rated, and no cask beer on any of the other times – but they’ll both get an NBSS average score of 2. (You may want to swerve both of them, admittedly.)
What would I do instead? I’d have some text at the top saying “Please ignore this questionnaire if you don’t own a cat”, for a start. As for the CAMRA categories, I think it ought to be made clear that what we’re judging is that particular beer on that particular occasion – which in practice will mean a lot of the time what we’re judging on is condition. Other than that, the official versions of categories 3-5 are OK, apart from the typo and the ‘excellent beer’ reference in the rubric for category 4. Below 3 the categories get a bit more contentious. Personally I think I’d go for ‘Poor’ for 2 and ‘Undrinkable’ for 1, and just leave everything below 1 alone; I certainly don’t think there’s room for more than one meaningful category below 2. Ideally we’d probably use a 0-4 scale and shunt the whole thing down –
0. Undrinkable, took it back
1. Poor condition but drinkable
2. GBG quality
3. Excellent
4. Best. Beer. Evs.
– but a change of that scale isn’t going to happen until CAMRA’s taken over by a clique of statisticians and pedants, and that could take weeks to organise.
So we’re probably stuck with NBSS 0 (meaning ‘no cask ale’, sadly), NBSS 0.5 (meaning ‘this beer was undrinkable, I took it back’), and a continuous scale from NBSS 2.0 (‘poor quality but drinkable’) up to NBSS 5.0 (either ‘the best beer I ever hope to taste on this Earth’ or ‘one of the best beers I’ve had this year’, depending who you ask). It would be nice to get a bit of clarity on that last one; also, on whether we’re scoring the beer as a beer (wrong) or the particular beer in this glass at this moment (right). The latter isn’t a deal-breaker, though; those of us who are doing it right can just carry on. And if you really want to drink a pint with ‘considerable resentment’ so that you can score it as a 1.0, be my guest.