The problem with rating seminars out of five

Every major platform that aggregates seminar and training reviews uses star ratings. Some use five stars; some use ten; some use net promoter scores. All of them are measuring approximately the same thing — satisfaction — and all of them have the same fundamental problem as a guide to learning value: satisfaction and development are different constructs, and optimising for one often degrades the other.

This is not a theoretical observation. It has been replicated in learning evaluation research across several decades and several national contexts. The most consistent finding is that learner satisfaction is weakly positively correlated with retention of information in the short term, weakly negatively correlated with skill transfer in the medium term, and essentially uncorrelated with behaviour change over six months or more. The interventions that produce the most durable learning — spaced practice, interleaving, desirable difficulties, corrective feedback — are consistently rated less enjoyable than passive approaches involving entertaining facilitators and well-catered venues.

What star ratings actually measure

Seminar star ratings on aggregator platforms are primarily measuring: the quality of the facilitation (engaging speakers get higher ratings than dry ones regardless of content quality); the comfort and logistics of the event (venue, catering, room temperature); the extent to which the content confirmed what participants already believed (challenge is consistently rated lower than validation); and the social experience of the cohort (well-curated peer groups produce higher ratings regardless of the programme design).

None of these factors is irrelevant to a good learning experience. Engaging facilitation helps; comfortable environments reduce cognitive load; peer quality affects discussion quality. But they are factors in the learning experience, not evidence of learning outcomes — and as primary selection criteria for training investment, they systematically favour the wrong programmes.

The selection bias this creates

If the primary quality signal available to L&D buyers is star ratings, and star ratings primarily reflect satisfaction, then the market selection pressure is towards programmes that maximise satisfaction. The programmes that win on this metric are: inspiring keynote-style delivery where participants feel motivated but unchanged; content that validates existing thinking rather than challenging it; social experiences dressed as learning programmes; and short, comfortable interventions that create no productive discomfort.

The programmes that lose on this metric include: rigorous case-based programmes that require genuine preparation and produce discomfort when participants are wrong; skill-development interventions that involve corrective feedback and require participants to practise in front of peers; and honest assessments that require evidence of capability rather than self-reflection.

Smart Seminar does not use star ratings. The Verdict Band system communicates evaluation outcomes as qualified statements — "Strong for experienced PMs in structured environments" — because a qualified statement carries more information than a number, and because the information that matters to a professional development decision is not "did past participants enjoy this" but "for whom does this work, and why."

The evaluations section applies this approach to specific UK certifications. The Provider Assessment Framework covers what to ask before booking a specific seminar provider.