top of page

The Coaching Echo Chamber: Is Your Methodology a "Black Swan"?

Apr 7
3 min read

Updated: Aug 31

Ever felt like you’re being “herded” into a specific way of coaching? For a long time, Europeans were certain all swans were white. Meanwhile, in Australia, everyone knew for a fact they were black. Both groups were right within their own worlds, but they were trapped in observation bias—an echo chamber of their own making.


The problem with coaching jargon


In modern coaching, we’ve built similar walls. If you aren’t using the "jargon of the day"—terms like constraints-led approach or ecological dynamics—you’re often told you aren’t "coaching," you’re just "drilling".


Your coaching method is a "Black Swan", or is it?
Your coaching method is a "Black Swan", or is it?

Why there is no 'best' coaching method


There is a booming industry selling these frameworks as the only way to develop expertise. But here’s the reality:


  • No "Best" Method: We have no convincing evidence that one coaching style consistently beats another.

  • The Jargon Trap: Experienced coaches who have been successful for decades are being made to feel incompetent because they don’t speak the right "academic" language.

  • The Obfuscation Factor: Sometimes, theories are made unnecessarily confusing just to shield them from criticism.


If you want to be able to spot an echo chamber, ask yourself these three questions:


  1. Is the language unnecessarily dense?

  2. Do I feel "dumb" for questioning the method?

  3. Are simple concepts being dismissed by "experts" just because they aren't wrapped in fancy terminology?


Now it is time to start trusting your gut


I’ve observed world-class coaches for years. Interestingly, there is no correlation between a coach’s skill level and the specific methodology they subscribe to. Many great coaches use "evidence-based" methods without even knowing the names for them. Let's take a closer look at how you can evaluate coaching methods.


How to evaluate a coaching methodology's evidence base


There is a simple question most coaches never ask about the framework they use: what would it look like if this methodology were wrong?


A methodology that cannot be falsified - one that explains every outcome, including contradictory ones - is not a scientific framework. It is a belief system. And there is no shortage of coaching belief systems dressed in academic language.


When you are evaluating any coaching approach, ask three things.


First: does the evidence come from real athletes in real sporting contexts? Much of the research that underpins popular coaching frameworks is conducted in laboratory settings, with participants performing simple motor tasks under controlled conditions. That is a legitimate starting point for understanding mechanisms. It is not a legitimate basis for prescribing coaching practice in a professional sporting environment, where the decision-making demands, fatigue profiles, and environmental complexity bear no resemblance to a lab.


Second: who funded the research, and who benefits if coaches adopt the methodology? This is not a conspiracy-theory question. It is a basic principle of evidence evaluation. When the researchers developing a framework are also selling training packages, accreditations, and conference keynotes based on that framework, the incentive to publish confirming evidence is significant. That does not make the research wrong. It does mean the burden of proof should be higher, not lower.


Third: what do coaches who don't use this methodology achieve? Selection bias - seeing results in the coaches and athletes who already subscribe to a framework, while ignoring the equally capable coaches who never heard of it - is the most common error in methodology evaluation. Some of the most technically sophisticated coaching I have observed in elite sport was done by practitioners who had never read a peer-reviewed paper and had no framework allegiance whatsoever. They watched carefully, thought clearly, and adjusted constantly.


That is, as it happens, what the evidence on coaching expertise actually identifies as the common thread: not a methodology, but a disposition.


The coaches who are easiest to impress with a new framework are often those who are least secure in their own observation skills. The coaches who are hardest to impress are typically the ones doing the most effective work. That pattern is not an accident.


If a framework you are using makes your athletes better at competing — not better at the drills the framework recommends, but better at the actual decisions and movements competition demands - keep using it. If it does not, the jargon was never the point.


The BUILD pathway covers how to evaluate practice design decisions using current research in skill acquisition - without requiring you to adopt a specific framework.


The Bottom Line: If a framework requires you to learn a whole new language just to explain what you’ve been doing successfully for ten years, ask yourself: Who is that language really serving?. Let’s stop arguing about the colour of the swan and start appreciating how well it flies.


Comments


bottom of page