...Group Together.
When WSS' Great Wargaming Survey respondents are asked to list their Top 3 wargaming periods (see Wargaming Period Preference), the counts of wargaming periods from most to least popular are as shown in Figure 1 below:
The previous analysis examined a selection of demographic attributes shown to hold some influence on wargamer's choice in periods. Relying on aggregated counts only, descriptive statistics were utilized in making inferences on general tendencies. In today's analysis, we drop the path to descriptive statistics and examine period preference using predictive analytics through the lens of cluster analysis.
What is cluster analysis? Simply, cluster analysis constructs a grouping of objects (period preference) so that objects in the same group (cluster) are more similar to each other than to those in other groups.Cluster analysis is a statistical technique used to identify and classify homogeneous groups of similar objects or data points into clusters based upon their characteristics or attributes. Such objects within the same cluster are more similar to each other than to those data points in nearby clusters. Cluster analysis is an unsupervised machine learning technique. "Unsupervised" reflects that analysis results do not rely on any predefined labels or categories. Instead, machine learning techniques "discover" patterns and structures present within the data itself. Cluster analysis can provide a powerful exploratory data analysis tool capable of revealing hidden structures and patterns even within complex datasets.
What are some questions that cluster analysis may answer? For me, a few questions to consider are:
- Using only gaming period choice, do distinctions between historical and non-historical gamers emerge?
- Do some game periods tend to cluster together? Which ones?
- If distinct groups emerge from clustering, are these distinct groups intuitive?
The first step in cluster analysis (after wrangling the data into shape for analysis) is figuring out an optimal number of clusters. With 5,995 respondents having up to three period choices each, these resulting responses are aggregated and classified using cluster analysis. Only respondent choices are utilized in building this model. Figure 2 illustrates the initial dendrogram showing how each of the twenty wargaming periods group.
What does Figure 2 suggest? The answer depends upon the number of clusters chosen but clear clustering emerges. What can we infer from this initial dendrogram? Without examining the dendrogram more closely, it may be difficult to identify any meaningful inferences at a glance. This is where identifying the number of clusters comes into the analysis.
Starting from the right-hand side of the chart and drawing a vertical line down through the first two branches of the dendrogram tree identifies two clusters of gaming periods (see Figure 3). This is the two-cluster solution. The two, distinct clusters are highlighted. What does this first and primary division suggest?
Figure 3 |
The result illustrates that historical wargamers generally tend toward historical gaming while non-historical gamers generally tend to remain within non-historical genres. Notice within Non-Historicals that Warhammer periods show distinct separation from other Fantasy/Sci-Fi periods.
What if we want to see more granularity instead of the very high-level, two-cluster solution? We move the vertical bar to the left and cut across the dendrogram a second time. Moving the vertical cut to the left, the dendrogram is bisected across three branches to identify a three-cluster solution as shown in Figure 4. Note that the three-cluster solution keeps Non-Historicals separate and intact. Historicals, however, are further split. As seen in the two-cluster solution, the split in the three-cluster solution is intuitive in that the Historical groupings are clearly split between Modern and Ancients wargaming periods. Interesting that the Ancients gamers tend to separate from the Modern gamers with seemingly little interaction between the two groups.Staying with the Ancients Historical Gaming Periods for a moment longer, Figure 1 shows wargaming periods Ancients, Medievals, and Dark Ages hold ranks 7, 8, 9 in the period popularity summary. As a test of data reliability, I was curious if the period ranking would remain the same across two distinct groups. I conducted an informal survey on the Society of Ancients (SoA) Forum to address this curiosity. The question asked was, Although the sample size is small at 26 responses, the ranking seen in Figure 5 from the SoA survey maintains the same order as in Figure 1. That is, Ancients then Medievals then Dark Ages.
What happens to the clustering solution as we move from the three to four-cluster solution? Moving to the left and cutting the dendrogram one more time to reach a four-cluster solution shows that the Modern Historical cluster is split once again.
What if we want to see more granularity instead of the very high-level, two-cluster solution? We move the vertical bar to the left and cut across the dendrogram a second time. Moving the vertical cut to the left, the dendrogram is bisected across three branches to identify a three-cluster solution as shown in Figure 4. Note that the three-cluster solution keeps Non-Historicals separate and intact. Historicals, however, are further split. As seen in the two-cluster solution, the split in the three-cluster solution is intuitive in that the Historical groupings are clearly split between Modern and Ancients wargaming periods. Interesting that the Ancients gamers tend to separate from the Modern gamers with seemingly little interaction between the two groups.Staying with the Ancients Historical Gaming Periods for a moment longer, Figure 1 shows wargaming periods Ancients, Medievals, and Dark Ages hold ranks 7, 8, 9 in the period popularity summary. As a test of data reliability, I was curious if the period ranking would remain the same across two distinct groups. I conducted an informal survey on the Society of Ancients (SoA) Forum to address this curiosity. The question asked was, Although the sample size is small at 26 responses, the ranking seen in Figure 5 from the SoA survey maintains the same order as in Figure 1. That is, Ancients then Medievals then Dark Ages.
What happens to the clustering solution as we move from the three to four-cluster solution? Moving to the left and cutting the dendrogram one more time to reach a four-cluster solution shows that the Modern Historical cluster is split once again.
In a four-cluster solution (Figure 6), Non-Historicals and Ancients Historicals clusters remain unchanged. Rather, with this cut, Modern Historicals splits into two groupings. This bifurcation seems to carve out Musket & Rifle periods from more Modern periods. We could similarly group these into Pre and Post-20th Century groupings too.
What about grouping of Old West and Age of Sail/Pirates into the Modern camp? This is an odd grouping, isn't it? Well, given that counts for both Old West and Age of Sail/Pirates groups were low as seen in Figure 1, variability and fuzziness in grouping is possible. In Figure 7, I label this cluster as Hollywood Historical. The grouping with Historicals suggests that Hollywood gaming tends to come from Historical wargamers and not non-Historical gamers.
I could continue crawling out on the branches of the dendrogram tree, pruning along the way, but for now, I stop at the four-cluster solution with the Hollywood split. Did I manage to answer some of the questions originally set out at the beginning of this analysis? To recap...
- Using only gaming period choice, do distinctions between historical and non-historical gamers emerge?
- Indeed! The two-cluster solution identifies this bifurcation early on.
- Do some game periods tend to cluster together? Which ones?
- In the 2024 survey as well as in previous cluster analyses, wargaming period preferences tend to group within the same clusters. There is some movement between survey years but generally, groupings remain consistent.
- If distinct groups emerge from clustering, are these distinct groups intuitive?
- The two, three, and four-cluster groupings identified were given (what I consider) intuitive names. Now, other labels are possible but cluster labels identified here seem to capture the component periods.
This exercise in cluster analysis produces some interesting and hopefully logical tendencies as responses are grouped by wargaming period preference. Keep in mind that these groupings, wherever pruned, are brought to light by simply examining respondent choices in game period and using the tools of machine learning. Notice, once again, the clear and early distinction between non-historical and historical game periods using no more input than a survey respondent's period preference.
Hope you find these results of interest as well.
Interesting to see WH gaming only manages third and fourth popular in its own cluster. And that the top three historical periods belong in three different clusters in your four cluster solution
ReplyDeleteThose are interesting observations, Anthony! Having the Top 3 Historicals in three different clusters is something I had not identified. It makes sense since WW2, Napoleonics, and Ancients are very different and may attract different gamers.
DeleteI can't pretend I really understand any of this Jon! However I see that I game the most and least popular periods, namely WWII and 19thC other, with a good mix inbetween. Why? Well based upon past musings I like to chop and change periods when gaming, so I'm not playing the 'same game' but with different figures so to speak. So if WWII was my most recent game/campaign, then I might go for some 18thC SYW type games for something completely different. Variety is the spice of life and all that!
ReplyDeleteWell, then I have failed! As a basic take-away, Historical gamers are much different from non-historical gamers in the periods they choose to game. Historical gamers can similarly be broken down into assorted subgroups. This inference is discovered only from looking at (and aggregating) Top 3 three periods across all responses.
DeleteYou haven't failed Jon, it's just that maths/statistics was never my forte! I get the reasoning behind it etc and can broadly understand the process, but after another read through it is making more sense. Note to self must try harder;)!
DeleteHoorah for perseverance!
DeleteLike Steve, I'm afraid I didn't understand a word of your post or the aim behind it! ☺
ReplyDeleteMy observation would be that the WSS readership (or rather those that responded to the survey) would appear to favour the more popular mainstream rules.......
WW2 would cover FoW, Bolt Action and Chain of Command (Lardy fans seem prevalent in WSS), as well as O Group and old favourites like (God knows why) Rapid Fire....
Interesting for Gronards like me who saw Nappys and Ancients eclipse WW2 in the popularity stakes many years ago....
Neil
Well, I tried and my response to Steve applies here too! My aim was to demonstrate how underlying (and perhaps unobservable) tendencies can surface with recognizable groupings given limited inputs.
DeleteI reckon WWII is popular even among the non-WSSers. See my earlier period analysis that breaks down period by Age Group and Location.
I notice that P&S is in with C18 rather than the Medievals this time around...
ReplyDeleteCurious, isn’t it? P&S has a tough time knowing where it should counted. Much remained the same but there was some period movement between groups.
DeleteI have done three statistical papers in two of my degrees but never really spent much time on cluster analysis so find the mechanics of this interesting. Interesting to see how some of these clusters emerged from the data, especially the Hollywood Historical which makes sense.
ReplyDeleteI think this an interesting exercise as well in that these groupings and clusters materialize with only one input across about 6,000 responses. The underlying clusters are intuitive too.
DeleteI read this and went away and re-read it, interesting read, the clusters make for plenty talking points. I must admit I always group P&S with 18th century in my collection but then all my P&S tend to be later in the period. Interesting post Jon.
ReplyDeleteGlad you stuck with it, Donnie! Last year, P&S shot grouped loosely with Ancients/Dark Ages/Medievals but clustered with 18th Century this year, fitting your own grouping.
DeleteThat is a really interesting piece of analysis. I like the way that you get understanding by chopping back the arms to get meaningful groupings. No real surprises in the major groupings of fiction v fact, but the high level lack of crossover from ancients & the rest was a surprise. Of course this is only the top 3 preferences/periods, and both you and I have considerably more than 3 historical periods in our collections. That broad spread of interest isn't caught by this analysis. I would think that for the ancients, for example, by subdividing into the three of Classical/Dark Ages/Medieval anyone who does a lot of e.g. DBA will find this forces their top three categories into "Ancients". I know it would for Phil S, but then I also know that he has a massive WW2 collection as well. If the categories for WW2 were "Eastern Front", "Western Desert" and "Normandy" then a lot of players top three choices would exclude other periods. As ever, you can only do what you do with the data that's asked for, and taking from the effectively self selecting data contributors.
ReplyDeleteAnd there's no way full on P&S should ever be grouped with medieval.
While this analysis may give some a headache, pleased to see that you made it through and found it interesting. Cluster analysis can be quite revealing in the discoveries and relationships unearthed.
DeleteI agree that the survey cannot capture all things but what I have found over the years is that making question responses unlimited, respondents have great difficulty in ranking more than about three items. Your example with DBA is about armies and not periods. If a gamer only games Ancients then only one period would be listed in the survey. I know that you and I have vast interests and collections and could not imagine having such little diversification. Same applies to the theatres in WWII. For period, WWII would be the choice even though a gamer might have many subperiods as you list.
As for the survey, itself, I test data reliability frequently. Over the years, even with a constant influx of new participants and self-selection, the results remain consistent. Now, P&S last year saw a weak relationship with the Ancients/Dark Ages/Medieval grouping. This year, P&S finds itself alongside 18th Century. "Full on" P&S might not be best fit to Medievals but the early Great Italian Wars battles sure look like Medieval battles to me.
Thanks for your response!
I wouldn't call early Great Italian Wars "Pike and Shot". Tactically it has very little in common with the late 16th into 17th century warfare.
DeleteOw - I think I have pulled a muscle in my head! Interestingly, I play at least one period in all 5 clusters viz Old West and Pulp in the two outliers, several in the Modern and Musket/Rifle categories, and Dark Ages and Ancient (thanks to my recent 10mm adventures) in the fifth!
ReplyDeleteAt a rough count I play 14 of the 20 sub categories. At least.
DeleteSorry for the muscle pull, Keith! Similar to Graham, I regularly see 12 of the 20 periods on the gaming table.
DeleteGreat working on the groupings. Will be able to comment in detail Saturday.
ReplyDeleteThanks, Joe! Come back when you are able.
DeleteThanks for posting this. Most interesting.
ReplyDeleteI have a comment in the ancient/medieval vs other historical period break: I wonder if this is rather a “competition gamers bs non competition gamer” rather than a preference for period.
Only other big competition set in historical is Bolt Action/FoW. A bet a look at comp vs others would give some interesting insight.
Hi Milton, glad this topic is of interest to you. Could the break be due to competition v non-competition gamers? That might be a possibility. I know many members of the Society of Ancients participate in competitive gaming. There is a question on the survey that asks about style of play including tournament play. I will look into that question and see what pops out. Good question!
DeleteHistorical games tend to cluster together in groups pretty easily by technology level (spears, muskets, machine guns) but I would think that high popularity of sci-fi is that it's crazy diverse and basically all encompassing.
ReplyDeletebut I like to see my where my favs are at.
Right in the middle. 😁
Clustering by weapon system does seem constant. Do wargamers tend to settle into a particular weapon technology and stick with that class of game periods? I cannot imagine such a policy.
DeleteBack in the day there were certainly groups of "Ancient" and "Napoleonic" wargamers, who mostly didn't cross over - except, of course that the Wargaming Greats like Featherstone, Grant and Wise played everything. Nowadays I'd say that this isn't true, although my data group would be people I know and wargame with. You, like me, have everything historical from bronze age to mid-late 19th century at least. There may well be "campaign creep" where players find a set of rules they like, like "Sword and the Flame", and then see what else it can be used for.
DeleteInteresting as always, though the self selection of WSS fans does significantly limit the overall data set. I think it appeals to a limited niche within the hobby as fewer people purchase hobby magazines. The fact that both WSS and WI have seen fit to appeal to fantasy crossovers in the last few years indicates there may be a greater appeal to drag a few of lapsed GW refugees into the fold. Given the overwhelming domination that GW holds over the miniature market, it seems to make some sense.
ReplyDeleteAs mentioned by others I am curious what the data would look like if we broke it down by company rather than period: I.e. Warlord Games, TooFarLardies, etc. Do people's preferences change based on new branches or offering? (i.e how many people went with Old West in response to What a Cowboy! or Dark Ages following the release of Midgard?)
While self-selection can be an issue, I am not sure that WSS fans are driving the results completely. If that was the case, I doubt we would see so many fantasy/sci-fi respondents. Maybe there is a lot of crossover from non-historicals as you suggest? Usually, about 40-50% of respondents are first time participants and I see calls to complete the survey on non-WSS social media.
DeleteThe survey has always been product agnostic with no singling out of rules, figures, etc. As for new rules driving interest, this topic was recently raised on the Society of Ancients forum wondering whether Midgard, Lion Rampant, and similar could drive interest from non-historicals to historicals. I wonder.
Interesting, especially the debate in the comments about a home for pike and shot, clearly a waif who needs their own home, not with beastly medieval mechanicals or snooty nosed 18th century with their smelly wigs! Full on pike and shot, sounds vaguely unpleasant for some reason?
ReplyDeleteBest Iain
The Great Italian Wars has an identity crisis.
DeleteInteresting post Jonathan.
ReplyDeleteWith that analysis you are starting to make playing with toy soldiers respectable! 😂
Are you suggesting that wargaming has an image problem?
Delete