Welcome to Regression Alert, your weekly guide to using regression to predict the future with uncanny accuracy.
For those who are new to the feature, here's the deal: every week, I break down a topic related to regression to the mean. Some weeks, I'll explain what it is, how it works, why you hear so much about it, and how you can harness its power for yourself. In other weeks, I'll give practical examples of regression at work.
In weeks where I'm giving practical examples, I will select a metric to focus on. I'll rank all players in the league according to that metric and separate the top players into Group A and the bottom players into Group B. I will verify that the players in Group A have outscored the players in Group B to that point in the season. And then I will predict that, by the magic of regression, Group B will outscore Group A going forward.
Crucially, I don't get to pick my samples (other than choosing which metric to focus on). If I'm looking at receivers and Jaxon Smith-Njigba is one of the top performers in my sample, then Jaxon Smith-Njigba goes into Group A, and may the fantasy gods have mercy on my predictions.
And then, because predictions are meaningless without accountability, I track and report my results. Here's last year's season-ending recap, which covered the outcome of every prediction made in our nine-year history, giving our top-line record (51-17, a 75% hit rate) and lessons learned along the way.
Our Year to Date
In Week 2, I laid out the four primary goals of Regression Alert. The first was to persuade you that regression to the mean is a real, actionable force in fantasy football. The core of that effort is making specific, concrete predictions based on nothing but regression to the mean and tracking the results over time. Here's a list of every prediction we have made so far:
- I predicted that high-volume, low-ypc running backs would outrush lower-volume, higher-ypc backs over the next four weeks (Week 4).
- I predicted that high-yardage, low-touchdown receivers would outscore low-yardage, high-touchdown receivers (Week 6).
- I predicted that high-interception teams would throw fewer total interceptions than low-interception teams (Week 8).
- I predicted that big favorites would go back to covering the spread around 50% of the time (Week 10).
- I predicted that, over a sufficiently large sample, the backs from our earlier prediction would finish within 0.3 ypc of each other (Week 10).
The Scorecard
| Statistic Being Tracked | Performance Before Prediction | Performance Since Prediction | Weeks Remaining |
|---|---|---|---|
| Yards per Carry | Group A averaged 29% more yards per game | Group A averaged 43% more yards per game | None (Loss) |
| Yards per Touchdown | Group A averaged 20% more fantasy points per game | Group B averaged 4% more fantasy points per game | None (Win!) |
| Interceptions Thrown | Group A threw 59% as many interceptions | Group B has thrown 91% as many interceptions | 1 |
| Favorites Covering | Touchdown favorites were covering 33% of the time | Touchdown favorites have covered 100% of the time | 3 |
| Yards per Carry (Redux) | Group A averaged 1.22 more yards per carry | Group A averages 0.30 more yards per carry | 7 |
With two fewer interceptions than Group A in Week 10, Group B increased its lead heading into the final week. Meanwhile, teams favored by 7 or more points went 3-0 against the spread, which means they've now covered seven straight after opening the year 6-20-3.
Gambler's Fallacy and Regression to the Mean
Before we start today's discussion, a quick quiz:
Imagine a receiver plays especially well over the first eight games of a sixteen-game season, averaging 100 yards per game (on pace for 1600 total). Imagine that we also happen to know this player is overperforming; his "true mean" performance level is just 80 yards per game. How many yards per game should we expect this receiver to average for the full year?
We'll get to the answer in a bit.
The goal of this column is to convince you to view regression to the mean as a force of nature, implacable and inevitable, a mathematical certainty. I can generate a list of players and, without knowing a single thing about any of them, predict which ones will perform better going forward and which will perform worse. I like to say that I don't want any analysis in this column to be beyond the abilities of a moderately precocious 10-year-old.
But it's important that we give regression to the mean as much respect as it deserves... and not one single solitary ounce more.
This is difficult because regression is essentially the visible arm of random variation, and our brains are especially bad at dealing with genuine randomness. We're just not wired that way. We see patterns in everything. There's even a name for this hardwired tendency to "discover" patterns in random data: Apophenia.
A fun example of apophenia is pareidolia, or the propensity to "see" faces in random places. Our ancestors used to tell stories of the "Man in the Moon". We... type silly faces to communicate emotion over the internet. Yes, pareidolia is why I can type a colon and a close paren, and you'll immediately know that I'm happy and being playful. :)
Our ability to "see" these faces is surprisingly robust. -_- is just three short lines, and not only do most people see a face, they also mentally assign it a specific mood. '.' works as well. With small changes, I can convey massive differences in that mood. (^.^) and (v.v) are remarkably similar, yet the interpreted moods are drastically different.