The Study – Differential versus Calibrational

The Study – Differential versus Calibrational

This article explores a study I conducted which will completely transform your view of improving your golf.

When I worked in Austria, I was lucky enough to have an endless supply of fresh beginner golfers with no preconceived ideas of how the game should be played. This was a great chance for me to not only teach them golf, but do some research into how best to improve a skill-set.

My first study involved improving the player’s ability to hit the middle of the face; a vital skill for quality play.

Study Methods

Each participant was given a one hour lesson where they were shown

  • grip
  • stance
  • posture and
  • ball position

in basic. Much of this instruction was a simple ‘copy me’ approach, where I asked questions to the students to direct their awareness, such as “where is my ball in relation to my feet”?

After they had a basic idea of the swing, each participant was educated on the fact that, for optimal distance and control, the ball should be struck from the sweet spot, which equates (roughly) to the middle of the clubface.

We then did a 20 ball test (PRE) to see how many times they could strike a spot the size of a 1 euro coin drawn on the center of the face.

24 golfers were then split into 2 groups, with average abilities matched; Calibration (CAL) N=8, Differential (DIFF) N=8, and Combination (COMB) N=8.

  • The calibration group were asked to hit shots and try to hit the 1 Euro size circle as often as possible.
  • The Differential group has a line drawn down the middle of the clubface and were asked to hit 5 shots from the toe side, followed by 5 shots from the heel side.
  • The Combination group did a mixture of both practices, starting with the differential practice and finishing with calibration.

Participants did this practice for 3 x 1 hour sessions during the week.

After the first hour, a second 20 ball test was conducted (POST). Then, at the end of the week a final 20 ball test was completed (FINAL). The test parameters were the same for all groups – Hit the centre of the face in a 1 euro size circle.

sweet spot
CALI group tried to hit this size spot over and over

line

DIFF group tried to hit 5 shots from the toe side, followed by 5 shots from the heel side

Study Results

Below is a table showing the results of the study

So the calibration group improved by 10% after one hour (the most improved group after 1 hour), and by 16% after a week. Differential practice group improved the lowest amount after 1 hour (4%), but leapt ahead of the calibration group by the end of the week by improving 24%. The Combination group showed an improvement of 8% after one hour, and a massive 30% by the end of the week.

They were almost hitting half of their shots flush, which is quite an achievement for a beginner.

Discussion Of Results

All improved

The first point to note is that all golfers improved.

This is obvious, and I would have been doing a very poor job if they hadn’t gone from complete beginner to ‘better golfer’ in the space of a week. Even over the course of an hour, every group improved. This is simply down to the nature of learning – people generally get better at things the more they practice them, especially as a beginner.

However obvious this is, it is an important point to note. Lots of teachers can claim that their method improves golfers, but is it the actual method which is working, or is it the fact that someone is simply practicing more?

There could also be elements of Hawthorne effect, or certainly Placebo effect being involved. For this reason, it would be good to compare the groups against a control group. For example, if the control group showed improvements above and beyond another group (or all of them), it could be concluded that, although there was an improvement, the intervention was actually more detrimental than no coaching at all.

Unfortunately, collecting data on strike pattern without the control group being aware of what was going on was difficult (ethically), and so I decided to leave a control group out of it.

Short-term versus long-term – Calibration

It is important to note that there was a difference between the short term improvements and long term improvements in performance. The calibration group was the most improved after one hour, but the least improved after a week.

This can be very important information for both players and teachers.

If you need short term success and maximum improvement in a short amount of time (likely intra-day), it would be best to try a calibration style of practice, where you simply hit balls with the aim of doing it correctly each time. As long as you are getting good quality feedback and are aware of the goal, it will be valuable practice.

I believe the reasons for the quicker initial performance improvements are an improvement in confidence levels during the intervention, and neuromuscular priming. The Calibration group were seeking good shots, so they got to hit them more often. This builds a good feeling and gives the person a (false) sense that maximal learning is occurring. Also, as the player was trying to undertake one single task (hit the middle), they were sending the same unconfused signal to the brain and body. A less variable signal resulted in slightly better performance in the short term.

There is a dark side to this, which most people don’t understand about human psychology. If you perform too well, this increases EXPECTATIONS. I noticed that the majority of CAL group participants arrived the next day with the expectation to perform as good as they did the day before, and were more disappointed and frustrated when it didn’t happen immediately, which probably resulted in their lowered overall improvement at the end of the week.

Calibration practice provided instant gratification, but not necessarily better long term results.

But the message here is, if you are looking to improve your ability to hit the middle of the face before a round of golf, try simply calibrating it during the pre-round session. For teachers, to get the most improvement in performance out of your students in one single session, a calibrational approach may work best for most.

Differential

This group was interesting as they showed the least amount of improvement during the first hour, but beat the CAL group by the end of the week. This is the funny thing with learning – what happens in the short term does not always translate in the long term. There is also a difference between learning and performance, as I discuss in depth in The Practice Manual – The Ultimate Guide for Golfers.

The Differential group finished a close second by the end of the week. So why did they under-perform during the initial 1 hour testing?

From observing the students, it was clear that by asking them to hit the toe or the heel of the club during their training, even if they got it correct, the result was obviously poor. I think most people can’t see the end goal (even if it is explained to them very clearly beforehand), and so this group didn’t understand that they were actually getting better, even though they were hitting bad shots.

The difference was, they were INTENTIONALLY trying to hit poor shots as part of their intervention. If you do something intentionally and get quality feedback, there is so much more learning occurring than if you were to hit the same poor shot unintentionally and have no feedback.

For example, a shank is devastating if you didn’t mean to do it (especially if you don’t even understand that you hit it with the hosel of the club). But, if you intended to do that, it is actually improving your ability to match reality and intention, which will aid you when it comes to hitting the middle of the face. So the DIFF group went into the first hour of testing with poorer confidence, as they had spent the previous hour hitting shanks and toe shots.

Also, there is a good chance that the confused neuromuscular signals from alternating the goal (5 toes, 5 heels), combined with no calibration work, held back their improvement.

But, it is still worth mentioning that they improved. One of my beliefs for why they improved so much during the week was because

1. They saw that this style of practice can improve them
2. They built subconscious tools for changing where they hit on the face
3. They had lower expectations due to the difficulty of the task

Notes for the teacher – this is probably not the best method to use if you are looking to build the confidence of a player and to get them to come back to you if it is your first time together. The post-intervention testing can eliminate a lot of those problems by showing the player that they have improved at the end of the session, but by that time, the player may be feeling frustrated. It is unfortunate as, in the longer term, this actually shows a significant amount of improvement.

For players – don’t judge your learning by your results. Just because you are hitting poor shots doesn’t mean you are not learning. In fact, you may be learning more than if you were hitting good shots.

Combi group – The most improved

This group showed the second biggest improvement after one hour, and the most improvement by the end of the week. It seems that the differential practice helped to build the players’ ability to change where they hit on the face, and the calibration afterwards allowed them to manifest those new skills. I also think the order in which the intervention was conducted (differential practice first followed by calibrational) played a major role in the testing. Players went into the testing with higher levels of confidence than the DIFF group. I wonder if they would have had the same success had the order been switched?

I assume the reason why the initial testing was slightly lower than the CAL group was due to this intervention having more variation within it, causing a confusion of the nervous system during learning. However, after consolidation of this learning over time, players now had both the tools/adaptability to move the strike around the face, and the confidence of the calibration period they had undergone. This lead to the greatest improvement in performance over time – a good indication of actual learning occurring.

Notes for teachers and players – if you want the best amount of learning, mixing a bit of differential practice with calibration work is the best for the long run. It will not only allow you to do what you want to, but it will give you the tools you need to teach yourself.

Other Notes

I believe that one of the main reasons for a greater improvement within the groups which included some DIFFERENTIAL work was that there was an improved level of concentration during training. I cannot prove this directly, but it would seem obvious that, if you’re changing the shot by adding variance, it forces you to go through the mental preparation phase. This phase can be skipped out in the calibration training. This is why blocked practice usually falls short when compared to random practice.

A good analogy is if I were to ask you the same maths question over and over, you would soon zone out and not be computing anything in your head as you give the same answer over and over. Your performance would be great (as you would be answering quickly and correctly each time. However, if I were to ask you a different question each time, you would have to go through the process of thinking and calculating – which would make performance go down (speed of answer and possibly correctness), but learning in the long term would improve.

You are a special snowflake

***EXCLUSIVE*** USA: One of Kenneth Libbrecht's snowflakes. Kenneth Libbrecht is Professor of Physics at the California Institute of Technology. He has been studying snowflakes, ice patterns, crystal growth and ice formations since 1997. Using a specially designed photo-microscope called the SnowMaster 9000, Kenneth faces subzero temperatures to catch falling snow flakes and photographing them before they melt. Placing the snowflake underneath the micro scope, Kenneth illuminates the snowflake with coloured lights. These pictures show real snow crystals that fell to earth in Northern Ontario, Alaska, Vermont, the Michigan Upper Peninsula, and the Sierra Nevada mountains of California. PHOTOGRAPH BY Kenneth Libbrecht / SCIENCE PHOTO LIBRARY / BARCROFT MEDIA LTD UK Office, London. T +44 845 370 2233 W www.barcroftmedia.com Australasian & Pacific Rim Office, Melbourne. E info@barcroftpacific.com T +613 9510 3188 or +613 9510 0688 W www.barcroftpacific.com Indian Office, Delhi. T +91 997 1133 889 W www.barcroftindia.com

Also, not all golfers improved the most with COMB. Some improved more with the CAL approach, so while it is good to find generalizations which fit the majority (and most of the golfers clearly fit into the trend), it is important to know that everyone is individual, and coaching should be tailored to the student. You get to realize this the more you are with a person.

Coaching is a two way process, and is more of a trial and error situation. Staring with generalizations can get the majority to better answers faster, but the answer may be different for everyone. It is only through testing different things that you will come to better answers and find out more about yourself.

Counter-intuitive

A lot of this is counter-intuitive, and it happened to shape many of my beliefs I hold now. I think more research needs to be done, but it is clear to me from my studies, and further lessons, that people of all abilities seem to respond well to variance.

A lot of literature on motor learning now talks about how everything should be highly specific and we should practice with perfection in mind, but this study clearly shows the opposite (to a certain extent). The players who practiced context specific (CALI) improved the least. Players who hardly had any specific practice (DIFF) even won out against them. But it was the combination of both which showed the most improvements (COMBI).

But one thing is for sure, the idea that “perfect practice makes perfect” is not true and may even be harmful to maximising learning.

But I am a scientific mind, and so until further research is done on players of all levels, it is not definitive whether the results would carry forwards. However, Anecdotally, it is no surprise to me that some of the best players in the world can perform some funky trick shots which they may never use on the course. And Tiger Wood’s ability to shape the ball is impressive, as he demonstrates in clinics. And he practices it too – Hank Haney states in his book (The Big Miss) that Tiger practices the 9 ball flights (high low and mid trajectory of fade, draw and straight shots). This variable practice followed by undoubtedly hours and hours of calibrational work has not done too much harm for him.

I can attest personally that, since I have been practicing more variable and differentially, my game has come on leaps and bounds. I now never struggle to calibrate a good shot. If I feel I am hitting it from the toe one day, I can quickly identify and change that pattern – much quicker than I could when I was practicing hours and hours of Calibration. Also, this skill seems to transfer to whatever technique I use. I often practice with silly/poor swing styles (to see what my clients are feeling), yet can still manage to get it back on the middle of the face.

Take Home Notes

If you are going out on the golf course on the day, trying to calibrate one thing may provide the best results for you. But do not confuse this with learning.

You will get much better learning long term if you actually mix it up a bit, and the most learning will come from a combination of both.

So every practice session you have, try to pick something to improve and then find a way of adding variability before zoning in on what you want. This can be applied to movement styles as well as impact skills (such as divot control, strike control or clubface control). For example, if you are trying to improve your weight shift, try

For example, if you are trying to improve your weight shift, try

  • half of your practice trying to over-do it,
  • followed by underdoing it (or even complete reverse)
  • and then finish by zoning in on what you want.

Variability and Differential practice techniques may actually cause some performance disruption in the short term. Try to avoid using them close to playing an actual round of golf. A good practice schedule will include these elements, but will have them further away from important performance times.

When I teach better players, I usually get them to perform more variable work at least a week away from major tournaments, often more. But it will usually be on a sliding diminishing scale.

If you want to learn more about advanced training methods for golfers, click below to find out more about The Practice Manual – The Ultimate Guide for Golfers. The book has been a bestseller in the USA, UK, Canada and Germany.

click here advert

Also, if you want to learn more about how I put differential practice into use with more drills, along with other concepts and exercises show to dramatically improve strike quality, check out The Strike Plan by clicking the image below.

Strike plan enter

8 Comments

  • Chris I

    Great article Adam! I do practice variability in terms of shot shape, loft and ball position but I like the notion of differential strike control and will give that a try and see if it improves my impact consistency. I’ve read your Practice Manual and also have seen the Strike Plan videos. Thanks for your dedication to teaching and I look forward to learning more ways to improve my golf skills.

    • admin

      Thanks for the support Chris. Practicing in this way has had one of the biggest long-term benefits to my own game.

  • Golden Boy

    The golf swing is one of the easiest swings to learn. Every “Little Leaguer” possesses the foundation for one. Unfortunately, teaching professionals teach the swing to be extremely difficult, which is why player participation is collapsing. Stop making it complicated and start making it fun. By fun; enable the student to achieve immediate positive results and not regret, after one lesson, the money they spent on a series of lessons.

    • admin

      I agree with much of this, and hope you see that this study shows strike quality being one of the most foundational. I have developed many drills which make learning the skill of strike much more fun, and see results in a short period of time. This type of training is counter to the “complicated” swing theories, and focuses more on the skills and coordination required.

  • jeremy buttsworth

    I really like your approach and I feel my game has improved a lot doing some of the drills recommended from your strike program. Also I am reading your book which I like very much. In particular your ideas on giving the body a task and it will work it out is incredibly refreshing and has liberated me from concentrating too much on one particular aspect of my swing. My swing feels much more natural now even though it has changed. The study above is fascinating , however It reminded me of a lecture I went to recently demonstrating the fallibility of reading to much into studies with small sample sizes…ie only 8 in each group. If a number of golf instructors followed a standard program, larger numbers overall , and results were collated , it would be interesting. Im not saying your conclusions are wrong ,,far from it… just applying scientific discipline.

    • admin

      I agree completely Jeremy. I encourage others to also do their own testing. However, in the 15K hours of teaching I have done, I see this approach (differential practice) as being incredibly powerful. I can often take a player with an issue and resolve it very quickly with these methods. One other note – large sample sizes have their own issues too – individuality can be washed out. For example, in a study with 1000 people, it might show that 80% performed better with X approach. However, we cannot ignore the 20% other – this is why I conduct individual testing with each player.

  • Robert Suddeth

    I liked this read! It brings a lot of imagination into a practice session even if you are just sitting around the house and decide to hit a few balls into a net. When someone has the golfing bug they tend to practice swinging at all times during a day around their house without even putting a ball in front of them. But they wouldn’t even have to hit a ball hard to see the effect of what is going on with the differential practice. If the student came out to pay for his or her lesson they can have all of this taught in the hour that they have, by dividing the hour accordingly. How many balls can you hit in 15 minutes? By the last 15 minutes they can be looking for the center hit. It isn’t like your are setting time out for teaching the rules of golf, they are working on their swing and contact. When they leave the driving range, because of their golf addiction, they will try to implement these practice theories into thinking about their game. To me they would be able to see for themselves the most minimum way the balls reaction to the club face.

  • JR THOMAS

    …I find the differential practice idea intriguing, if a bit scary in its foreigness to us Western thinkers…but if I recall that most of my more challenging rounds are characterized by bouts of toe draws, it would make sense to learn how to move impact inward when I need to… : )

Post A Comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.