Tag Archives: Positive Reinforcememnt training

Training with a Marker Signal and Positive Reinforcement

Click & Scritch Bridget 01-08-2016_082102

Photo: Using targets as ‘destinations’ makes it much easier to give meaning to our request in a way that the horse easily understands. Reaching the target, whether it is putting the front feet on a mat or touching the nose on a stationary object, earns the horse a click&treat. We can then move between targets to encourage the horse to come with us willingly because there is always something for him to look forward to – the next click&treat when we reach the next destination.

Training with a Marker Signal and Positive Reinforcement

Training with the click&treat dynamic is a skill worth learning well, but it is not the only thing we have to learn well.

Some people handle/condition a horse’s behavior in a way that encourages the horse to always look to the handler – a form of ‘learned helplessness’.  The horse is asked to subjugate his own observations, feelings and natural responses in favor of what the handler requires him to do.

Other people set themselves the interesting challenge of doing everything with their horses using only positive reinforcement training (often called ‘clicker training’).  They pair each desired response with a marker signal (click) followed immediately by a food treat.  They feel that this is the only way to keep a horse’s ‘sparkle’ alive.

Somewhere between these two extremes, fall the people who teach many things with the click&treat dynamic, but they also understand, respect, learn and use universal horse language.  In their view, any horse education system that fails to acknowledge group social order, different horse character types and how horses succinctly communicate with body language, will have limited success.

From our human standpoint, we could define ‘success‘ as having a horse that is safe and fun to be with and that we can take places for exercise to maintain blood circulation health, overall fitness and mental stimulation.

Success could mean that the horse:

  • greets us willingly
  • enters our space politely
  • offers feet confidently for foot care
  • accepts gear on and off comfortably
  • leads safely and willingly in a variety of positions
  • responds equally well to upward and downward transition requests
  • confidently accepts touch and grooming all over its body
  • confidently accepts ropes draped all over its body and legs
  • willingly, at request, moves away from a food dish, pile of hay or grazing spot
  • not unduly spooked by dragging ropes, wheelbarrows, flapping things, balls, bicycles, vehicles
  • able to stay ‘parked’ quietly or stand and ‘wait’ for a further signal
  • confident moving through gates/narrow spaces/lanes and over water/unusual surfaces at our request
  • approaches new/spooky things as long as we give him the approach & retreat time to convince himself it is harmless
  • at ease with any body extensions the handler might use to clarify or accentuate signals

Once we have all that, we can endlessly refine the basics and teach new patterns and tricks.

Teaching with the click&treat dynamic is hugely helpful to horse handlers for two main reasons:

  1. Encourages accurate observation of what the horse is doing in order to pick the ‘clickable moments‘, which are also the moments that signal/cue pressure is released.  Therefore becoming a good clicker trainer also hones the skill of becoming an excellent trainer with simple ‘release reinforcement’.
  2. It teaches ‘thin-slicing’ — the cutting of a large task into its smallest ‘clickable’ components so that we can get the horse confident with each tiny ‘slice’.  Then we can chain the slices together until the whole task is achieved.  This way of teaching/learning, often called ‘mastery learning‘ keeps the horse successful all the way through the process.  A clicker-savvy horse knows that if the click&treat is withheld, they need to try something else.

Developing the two skills above will greatly increase the ‘feel‘ of the handler.  That ‘feel‘ will translate to the times when a good choice is use of ‘release reinforcement’ by itself.  Feeling what the horse is doing — understanding what his body language is saying and knowing how to respond to that with our feel and body language, is the key to training with signal pressure and release of signal pressure (‘release reinforcement’).

What horses gain from positive reinforcement  Horses trained with the click&treat dynamic discover that they can have a voice.  Once they learn that a certain behavior will earn them a click&treat, they can become pro-active in offering that behavior.  For many horses this is huge because in the past things have only been done to them or demanded of them — they could only be re-active.

When a task is thin-sliced so they understand each part of the training process, the horse’s learning can progress in leaps and bounds.  We’d all rather work for a boss who praises what he likes rather than one who only criticizes what he doesn’t like.

Horses are not blank pages on which we write what we want.  They already have a perfectly good language.  It seems logical to learn it and use it as best as we can with our non horse-shaped bodies.  Horses are very generous with their interpretation of what we mean.  No doubt we have a very funny accent, but unless they have been traumatized by humans, they are happy to learn new things and accept us as part of their personal herd.

Social Group  Once the horse accepts us as part of her personal ‘ in-group’, we have a position in the group social order.  The two things go together.  We can’t form a bond of understanding with a horse unless he or she lets us into their social group.  Once we are part of the social group, we have a ranking within it.  If the horse can move our feet at will, she or he stands above us in the social order.  If we can ask move the horse’s feet, we rank above him her in the social grouping recognized by the horse.  When people don’t understand this dynamic, or chose to deny/ignore it, things might not go well.

Horse Character Types  Like us, horses can be innately anxious or innately confident and imaginative.  They come as extroverts who like to/need to move their feet a lot and they come as introverts who prefer the quiet life.  A careful look at how our horse perceives and reacts to things can give us insight into how we can best proceed with an individualized training program.  What works perfectly with one horse can be quite problematic with another.

Universal Horse Language  Horses have a complex communication system using their body language and a few vocalizations. They ‘message’ other horses with body tension, body orientation, neck position/movement, ear position, tail activity, posturing, striking out, kicking, biting, nibbling.   How they use each of these depends on their intent at the time.  An ‘alarm snort’ will instantly have the whole herd on alert. Quietly turning the head away as another horse (or a person) approaches is an appeasement signal.

With the aid of body extensions which make us as tall and long as a horse, and simulate a horse’s expressive tail, we can more clearly emulating universal horse language.  If we are good at it and use our movements consistently, any horse will understand our intent without us ever needing to touch the horse or use a rope.  We can establish our position in the social order by ensuring we can move the horse’s feet in a variety of situations while the horse is at liberty to move away, as it would be in a natural herd situation.

Once we have established our social position, we maintain it by the way we behave.  Anxious type horses may rarely challenge our position.  Confident, imaginative type horses may well challenge our position regularly.  In a natural herd situation, they have the drive and sparkle to work their way up the group’s social order.

With an understanding of, horse character typesequine body language,  and how the social order works, we can flow with the information the horse gives us via his behavior and body language.  Skills of observation, timing and ‘feel’ allow us to decide how we will use clicker training to make his life in his strange human-dominated world a little bit more interesting and understandable.

With equine clicker training, we experiment to find out what the horse can already do, then build his skills in a way that has him being continually successful.

The link below contains a bit more information about horse character types.

PDF Ch 5 READING HORSES

 

Destination Training

mat cameo boots 10-30-2017_122916

Photo: Mats laid out in our training area make good destinations to encourage willing movement to the next destination to earn a click&treat. First we can have them close together, then further apart. Once the horse understands the game, we can use small ‘mat’ targets like plastic lids.

Destination Training

Destination training adds an important dimension to a horse’s ability to understand what we would like him to do.  We have to remember that the horse is captive to an alien species. Unless we take him through a careful, thin-sliced training program to teach him what we would like him to do, he has no way of knowing what we want.

While we are trying to figure out how to communicate with our horse, he is trying even harder to figure us out, and work out what we want him to do.

Giving the horse destinations helps him to make sense of many of our signals, because he sees a purpose to what we are asking him to do. He is not forever locked into a mystery tour.  Like us, to remain confident, horses like to know what is going to happen before it happens.

Target discs 1 10-26-2017_153255

Photo: Here we have set up a series of white target disks along a track. Boots earns a click&treat for targeting each one with her nose (or foot). Gradually we would spread them out further and further, eventually attach them in appropriate places along a longer walk or ride on a road or trail.

Once the horse eagerly targets hand-held targets, we can tie similar targets around our training area and ask the horse to walk with us from target to target. This gives us many opportunities to seamlessly show the horse that walking with us (being led) is a fun thing because we are always reach a destination that results in a click&treat.

We can ‘stretch the value of each click&treat’ by gradually putting the targets further and further apart and/or in more challenging places. Doing this, we continue to build the horse’s willingness to come along with us because he knows that we know where these magic ‘click&treat spots’ are.

For horses that are barn/buddy sweet (they are not confident about leaving home) we can set out targets in a curve that gently goes away from home and then returns home. As the horse becomes more confident with the game, we can make the curve further and further away from home.

Once the horse is keen to hunt out the next target to earn a click&treat, we can set the targets in a straight line leaving home, being careful to stay within a distance that allows the horse to remain comfortable. We click&treat at each target going away from home and again on the way home. Eventually the targets can be a long way apart.

wk on road 1 (2)

Once the horse is keen to walk forward to target a familiar object, we can use something like a Frisbee to toss ahead of us, walk to it, target it to earn a click&treat. Then toss it forward again, and so on.

target frisbee 1 10-26-2017_154327

More About Foot Targets

When we introduce mats as foot target destinations, we open up further possibilities for seamless teaching/learning. Once the horse is eager to approach his mats because he knows he will earn a click&treat, the mats can serve the same purpose as the nose targets — desirable destinations.

But that’s not all. When a horse learns to line up his front feet tidily on a mat, he will generalize this to a tidy approach to the mat so he can step on it elegantly. We have given him a reason to line up his body and use it with more precision.
An energy conserving horse will be motivated to speed up to reach the mat. A rushing horse will be motivated to calm and collect himself to reach the mat.
For teaching the leading positions, the mat helps sustain the horse’s attention and focus. We can also use a mat as a positive destination or  ‘relaxation spot’ to visit periodically while we work on more complex tasks.

Once the horse has established the habit of moving on with us to find the next target, we can introduce targeting of natural objects like trees or rocks, bushes, particular fence posts. We can also teach ‘target places’ like corners of paddocks or favorite grazing spots.

Video Clips Available

My  video clips are available on YouTube by searching for HorseGym with Boots or Herthamuddyhorse on the YouTube search engine.

 In this clip the targets are close together for ease of filming. I eventually tied rags to fences and hedges far apart so we did a lot of walking between a click&treat upon reaching each target.

Clips #3 – #14 of HorseGym with Boots go through the detail of using destinations to give the horse a sense of purpose when we are asking him to walk along with us.

Number 16 in my Blog Contents List (link at the top of this page) will take you the blog that has details about teaching smooth WALK ON and HALT signals.

Parameters: Setting the Rules for the Games we Play

Parameters

Photo: I’m teaching my horse, Boots, to back up to a mounting block. My parameters include backing straight (hence the guide rails for this early lesson), backing for 6-8 steps (she started at the fence on the right) and halting with her withers just in front of the two tubs. This time she moved back an extra step, but it was a very good response for early in the training of this task. I’ve stepped off the black tub so I could deliver the treat while she stayed in the position I wanted.

Parameters: Setting the Rules for the Games we Play

Because of their role in the web of life —  to be a meal for predators — horses are so much more observant than we are.  They read our mood the moment we appear.  They read our body language with exquisite care.  When something in the environment is different from last time, they notice instantly.

If we want to become good at communicating with our horse, it helps to become more aware of what our mood, our body orientation and our body energy may be saying to the horse.  Horses get confused and worried when our body language does not agree with what we are asking them to do.  Or if we use a similar message to mean two different things.

As horsemen often say, “Nothing means nothing to a horse”.  So if everything means something, it is good to be aware of the parameters we are setting when we interact with a horse.  Here is a bit more detail about what parameters are, and things to remember to become better teachers for our horse.

A parameter is something we decide to keep the same or constant.

For example:

  • Walking on the horse’s left side would be a constant or parameter you have chosen.
  • If you then change to walking on his right side, that is a new parameter.
  • If you decide to walk beside the horse’s ribs (where you will be if you ride) rather than beside his neck, you have changed a parameter.
  • If you decide to walk behind the horse rather than beside him, you have changed a major parameter.
  • When you ask the horse to walk with you on the road rather than at home in his paddock or arena, you have changed a major parameter.
  • Walking on an unfamiliar road or track is changing a parameter.
  • If you are walking together toward a familiar destination, where he knows he will halt to earn a click&treat, the first time you ask him to halt before he reaches the destination, you have changed a parameter.
  • If you are walking and change to asking for a trot or jog, you are changing a parameter.

Whenever we change a parameter, it is important that we increase the rate of reinforcement (i.e. click&treat more often) and work our way forward again until we and the horse are both confident in the new situation, with one click&treat at the end of a task or a series of tasks. For example, relating to the photo above, once Boots confidently backed up in a straight line to stand between the two tubs, I removes the rails (one at a time) and ask her to back up for just a step or two, then work forward again to get 6-8 steps straight back.

Horses are super observant of all changes, large or small, and can often be ‘thrown’ by them if we proceed too fast or ask for too much too soon. They also immediately pick up if we are unsure about what we are doing.

This is why it’s important to have a written Individual Education Program suited to this horse in this environment before we delve into teaching our horse something new. If we are clear in our mind about what we are working on, that confidence will be picked up by the horse.

If you want to look at 20+ training sessions to achieve the objective outlined in the photo above, done at liberty with no extra props, here is the link to the very first session (lessons were mostly one a day, weather willing and lasted about three minutes each day). I can’t ride any more (dodgy hips & knees) so we did this as a just an interesting training project. The second video clip below takes you to the last clip in the series, in case you don’t want to see all the others in between!

Safety

smile while st&s 2 06-16-2016_155354

Photo: Sitting with the horse in a roomy, enclosed area, asking nothing of him except politeness. This is a superb way to build a new relationship with a new horse or to to build an improved relationship with a horse we have already.

Safety

It’s only when we feel safe with our horse and our horse feels safe with us that real teaching and learning can go on.  If our horse makes us feel worried or afraid, we need to take heed of the feeling and organize our environment so that we can be with the horse in a way that allows us to regain our safe, calm, centered core. Maybe we need to sit in our chair just outside the horse’s enclosure to start with.

It will be difficult for a horse to remain in his calm, centered core in our presence if we are sending out vibes that tell him we are uneasy and nervous.  A good first step is to spend undemanding time with the horse, in his home if we feel safe there, or on the other side of a fence or gate if we don’t.  We need to carry a swishy type body extension so that we can enlarge our bubble without offending the horse by striking out toward him.  Horses are very sensitive to the air movement of two swishy twigs or dressage whips, or the swishing of a string rotated like a helicopter blade.

Horses easily understand when we are merely enlarging our bubble of personal space.  If we strike out toward their personal bubble rather than just protect our own space, the horse will realize it instantly.  It is important to be aware of the difference between acting in an assertive way and acting in an aggressive way, and to be mindful of which one we are doing.

As we sit with our horse, we can read, meditate or just enjoy the quiet of being in the moment, looking and listening and breathing.  It’s nice if the horse can be in a roomy area where he is comfortable, able to see his companions but not where they can interfere with your special time together.

It works well to set a time limit.  It doesn’t matter what the horse does.  We are there as a companion, a paddock mate for the time we have set.  We expect nothing of the horse except politeness.  If he becomes overbearing, we move away with our chair or ask him to back off by swishing the air toward his feet to protect our personal bubble.

The PDF attached has a look at ways to ensure our safety.

Safety with Protected Contact and Body Extensions