Wednesday, March 5, 2008

Pavlov vs. Skinner

This section really has very little to do with every day life. Feel free to skip it unless you're a big behavior nerd like me.

There are two types of conditioning or learning. One is Classical Conditioning and the other is Operant Conditioning.

Classical conditioning happens when the student makes a connection between two things. She then responds to the first event in anticipation of the second event. The response is not required for the unconditioned stimulus to appear. This type of learning is often associated with Pavlov and his drooling dogs.

Conditioned Stimulus or CS – a stimulus or cue which has no meaning and is presented before an unconditioned stimulus.

Unconditioned Stimulus or UCS – a stimulus or cue that always causes an unconditioned response.

Unconditioned Response or UCR – something that automatically happens in the presence of the UCS. It does not have to be taught. (May be a reflex.)

Conditioned Response or CR – what is taught to the learner when she associates the CS and the UCS.


Cousteau has learned that a certain route leads to the dog park. The first time or two we went to the park nothing happened. Then he made the association between that route and the park and from that point on as soon as we approach the route to the dog park he begins to howl and sing at the top of his lungs.

CS – the route to the park

UCS – being off leash around dogs at the park

UCR – enjoyment of freedom and fun

CR – anticipation of enjoyment of freedom and fun


Bug has learned that when we shop in a certain place we will stop for Starbucks. In the beginning we could do some shopping and if I felt like a hot drink we would go into the coffee shop. That routine has been repeated enough that as soon as we are at the cash register, Bug asks me if she can have a “vanilla milk”.

CS – our presence at a cash register at a certain shopping center

UCS – vanilla milk

UCR – crave vanilla milk (or drools...)

CR – ask to go to Starbucks for vanilla milk


Operant Conditioning is when a student understands that his behavior has consequences. He must do something to make something else happen. This type of learning is associated wit B.F. Skinner, Kellar Breland, Marian Breland Bailey, and Bob Bailey.

ABCs of Operant Conditioning

A ---> B ---> C

A = Antecedent or cue (or discriminative stimulus if you want to be fancy)

B = Behavior or the student's response to the antecedent.

C = Consequence (or punishment or reward) as a result of the behavior.


In flyball Havana is told to “hit it” and must go over the 4 jumps, hit the box, catch her ball and bring it back over the jumps to me. When I have the ball, she gets her tug.

A – hearing “hit it” (or just seeing the jumps and the box)

B - bringing the ball to me

C – playing tug


Bug has learned to sit in her chair if she wants popcorn at snack time. As soon as the popcorn popper comes out she goes to her chair to wait.

A – presence of popcorn popper

B – sits in chair

C – gets a snack of popcorn (or as she says, a “nack a POPtorn”)


This is also where the concept of Thorndike's Law or the Law of Effect comes into play. That is “if a consequence is pleasant, the preceding behavior becomes more likely. If a consequence is unpleasant, the preceding behavior is less likely.” Basically – you do something and something good happens, you'll do that thing again. Do something and something bad happens, you won't do that thing again.

If I was cruising for punishment I'd get into the four possible types of consequences, but since I understand those fairly well I won't risk confusing myself. :)

Technical learning theory jargon applied to dogs and kids

Wow, it's been an embarrassingly long time since I last updated my blog. You'd think with a toddler and two active dogs that I would have tons of time to write, but somehow I don't. Go figure!

This entry will be a bit of a departure from my other entries. I'm getting ready to take the Certified Pet Dog Trainer exam (www.ccpdt.org) and I'm going to multi-task and up date my blog while I solidify some concepts in my head. I'm a visual and physical learner so typing gives me the chance to read what I've written and it helps to get it stuck in my brain better. But more on learning styles when I get to that point in an entry!

Much of this section on basic vocabulary comes from Pam Reid's book Excel-erated Learning. As she explains in the intro, this isn't a “how to book” it's a “why” book – interesting for the dog owners out there but particularly useful for dog trainers. The format of my study entries will be a definition of the term, an example of the concept learned from working with dogs and another observed by working with my daughter or other children.


Learning
At the most basic level, learning is a change in behavior based on past experience.

Cousteau has learned that when I am out of the kitchen, putting the entire front end of his body on the counter will enable him to reach food anywhere on that surface.

Bug has learned that positioning her stool in certain locations along the counter enables her to reach almost anything on that surface.

Both Cousteau and Bug experimented several times before finding a technique that was effective and this is the first technique tried at the next opportunity. Before they would try to reach an object with all feet firmly planted on the floor.


Learning/Performance Distinction
The distinction between knowing how to do something and actually doing it.

Cousteau can execute a perfect heel pattern in a lesson. He has learned how to do it. However, when we are in a trial setting he does not perform a perfect heel pattern. Just because he does not do a heel pattern in a trial does not mean that he never learned how to do a heel pattern. (It just looks like it!)

Bug loves to sing. She has learned the words to “Twinkle, Twinkle Little Star” (or Tinkle, Tinkle, Widdle Stah). When asked to sing the song for guests she does not know well, she will not sing. The absence of her singing does not negate the fact that she has learned the words to the song.


Latent Learning
The act of learning how to do something but not having the ability to display that knowledge until later.

Cousteau has known for years how to get something off the counter, but he did not display that knowledge until Bug became old enough to leave food on the counter and walk away. (I swear I'm going to stop picking on the big yeller dog soon!)

Toddlers are great demonstrators of latent learning. Bug learned how and when to say one of my Dad's favorite phrases “It's a tough job, but someone's got to do it.” She did not display this knowledge until at least a day later when I offered to carry something heavy for her and she replied “It's a tough job, but someone's gotta dew IT.”


Four Stages of Learning
acquisition (acquiring) – first phase where new knowledge is acquired

fluency (automatic) – second phase – response is fluid and automatic and speed of response can be improved

generalization (application) – third phase – learns that new knowledge is relevant in a variety of places and circumstances. (Rarely automatic – must be emphasized during training)

maintenance (always) – new knowledge is incorporated into the learner's “tool box” of behaviors. Needs review to stay at this level.

Cousteau took about 2 years to go from the acquisition to the maintenance of flyball skills.

Acquisition: teaching him all of the little parts – first going over one jump and then two, three and four. Then triggering the box, passing other dogs, and dealing with distractions.

Fluency: going down four jumps, getting the ball, coming back over four jumps, and getting his tug without breaking it down or frequent cueing, so basically, the sequence became automatic.

Generalization: applying the knowledge of doing the entire sequence in practice and also in tournaments both home and away.

Maintenance: we continue to practice despite the fact Cousteau has the basic steps. He will (almost) always complete the flyball sequence no matter what – other dogs in the lane, bad passes, jumps knocked over, commotion on the sidelines, different handlers, etc.


Bug LOVES her tricycle. It was hands down her favorite Christmas gift and she went from acquisition to maintenance very quickly.

Acquisition: watching how the pedals move to push the bike forward and that moving the handlebars changes the trike's direction. Figuring out where to put her hands and feet.

Fluency: pushing the pedals first for any movement and then smoother and faster movement. Holding handlebars straight and then turning them to change direction.

Generalization: being able to ride the trike not just in the kitchen, but the living room and rec room and at Nana's house. (It's too darn cold and snowy to test generalization outside yet.)

Maintenance: riding the tricycle all over the place without thinking precisely about how she's moving her hands and feet.


Principle of Parsimony
The simplest explanation is usually the correct one, unless there is evidence to the contrary. In other words, if you're sitting at a horse ranch and hear hoof beats, don't assume there's a zebra coming.

Cousteau started drooling for no apparent reason. The first time it happened I checked in his mouth to see if there was anything caught there. This is a logical and simple explanation of the behavior. I didn't see anything, but noticed a broken tooth. He stopped drooling for awhile and then started it up again. Even though the tooth didn't appear to bother him during a couple of exams by some dog savvy friends, my vet, and myself, I decided that must be the problem and scheduled a removal. This is logical, but not a simple explanation. Three weeks after the removal he drooled again. This time I realized each previous episode was when he was around a female in heat and drooling is a common event for males when a female is in heat. A simple and logical explanation for the behavior and ultimate the correct one since I've now noticed he only drools in the presence of a female in heat.

Bug has been very cranky lately. I had begun to wonder if she had some sort of illness that didn't physically manifest itself as a fever, rash, or intestinal distress, but caused a change in her behavior. This is not a simple, nor especially logical explanation given the facts I have. She was just horrible at flyball last night – refusing to sit down or cooperate with me even in the simplest requests. I commented on the behavior change to a teammate who is also a nurse working up to asking her if she'd ever heard of such a disease. She told me her son went through the same thing at that age. Then we got home and discovered Bug had horrible diaper rash. Age-appropriate behavior and obvious physical discomfort are two simple and logical explanations of the behavior. (Diaper rash is cleared up today and she's much happier.)

Thursday, October 4, 2007

Cue Discrimination

One of the things I love about clicker training is that it encourages the student to try different behaviors without fear of being corrected for the wrong response. If I am teaching my dog to sit and she lies down instead, I don't do anything. I don't scold, place her in a sit or pop her collar. Nor do I praise, click, or reward her. I do absolutely nothing, which tells her she didn't get the behavior right. So she keeps trying other things in order to figure out what will make me click and give her a reward. Some animals will go through an amazing array of behaviors. This frustrates some people, but I always explain to my human students that it really means the dog is happy and comfortable in training and with continued work the dog will learn to associate "sit" with putting her bottom on the ground and nothing else.

Sometimes instead of trying a bunch of new behaviors, a dog will incorrectly link a couple of behaviors. I had an adorable Cardigan Welsh Corgi in my puppy class. We were working on "puppy push ups" - an exercise where the dog is cued to sit and lie down in rapid succession. The corgi knew "down" and he knew "sit", but he also knew that they'd been working on "roll over". So whenever he was asked to lie down from a seated position, he'd roll over before settling into the down. It was adorable, but his owners were embarrassed. After all, he was supposed to just do sits and downs! I explained that this is pretty normal behavior for a clicker trained dog and not to worry. If they worked on the sit and down separately and then only rewarded when he went from one to another without the roll over, he would learn the difference.

In our efforts to teach BabyBug to be polite, we've taught her to link a few responses that shouldn't be linked. It started off with saying "bless you" after people sneezed...or coughed...or cleared their throats. Then she started saying "thank-you-you're-welcome" whenever someone did something for her. Most people find this charming, but it embarrasses my husband a bit. I keep explaining to him 1) it's good that she does it at all, even if she sometimes gets it wrong and 2) she will learn to discriminate between the situations so she uses the proper phrase at the proper time.

Sure enough, on Saturday morning we were having a cuddle fest on the big bed and Bug gave me a kiss. I said "thank you" and she appropriately responded with "you're welcome" for the first time. Later on she thanked me for something without tacking "you're welcome" on to the end. She still forgets sometimes and combines the two, but she's started to understand the difference. And really, it makes me kind of sad. It was an adorable misunderstanding and she's just growing up so darned fast!

Self Control

Having a collie means that I have to deal with a fair amount of chasing, circling, and barking. Well, more than a fair amount of barking, really. Collies are freakin' loud when they want to be! Havana seems to have a hard time thinking when she's barking, so I've been trying to teach her some self control, but let her have fun, too. I don't want to completely suppress a natural instinct that she clearly enjoys.

I wish I could remember where I first heard of this particular self control exercise. It might have been Suzanne Clothier, although it pairs well with what Patricia McConnell, among other trainers, suggest in teaching paired commands. Havana and I go out to a large area and I get her all riled up - it doesn't take much! We play together while she leaps, lunges, barks, and whips around in circles and I egg her on. Then all of a sudden I stop dead and tell her "enough". Nothing she can do will entice me to play after I've told her "enough" and if she gets bratty, I will tell her to down. As soon as she quiets, I tell her to "get wild" again and we go back to our loud, rambunctious play. Then I tell her "enough" and she has to quiet and again, her reward for quiet is to get crazy. We repeat this several times and she never knows when it will end, but when it does it ends on a good note.

The change in Havana has been nice. She's catching on to the idea that there is a time and a place for barking and a time and a place for being quiet. The contrasts help her to accept quiet time a lot better, especially since she doesn't know if she'll be able to go crazy again or if the game is over. The not knowing seems to make her want to comply more quickly, which is exactly what I want.

After a few disastrous shopping outings with BabyBug, I decided to try something similar with her. As we walked between stores at an outdoor mall I told her that we could get our screamies out when we're outside, but inside the store we had to be quiet and polite. Then I asked "Do you have any screamies inside?" She nodded, so I said "You'd better let them out!" and we both released some screamies as we walked. Then I stood outside the store and asked if she had any more inside. She said she did, so I told her to let them out. We did repeat this about 3 times, but then she was ready to go into the store. And lo and behold, she was actually quiet! We went on to the next store and repeated our activity. Again, a relatively quiet toddler in a women's shoe store! Every once in awhile she'd start to get loud and I'd remind her that being loud is for outside. Then I had to remember to remind her to be loud when we got outside the store. It doesn't work as well if you set up guidelines for when to be loud and crazy and then never work within those guidelines.

This plan can backfire. I didn't bother to do a screamie check last week before going into a craft store, one of the places she's been obnoxious in the past. Sure enough, we get to the middle of the store and she starts shrieking just for the fun of it. I was mortified. So now I need to remember to go through our little routine before entering key stores. I really don't mind, though. If standing outside of a store doing some little shrieks and the occasional meltdown in the store are the price I pay for more frequent good shopping trips, I'm happy to do it.

Wednesday, October 3, 2007

If you love it, let it free...

When I teach puppy socialization classes I tell my students to try to ignore the puppies during off-leash play time. Yes, get involved if the puppies need them, but otherwise let them be dogs for 15 minutes a week. This is hard for some people. It's hard for some dogs, too. In every class there is one dog who will stick to their person and not move. They may be interested in the other puppies, but for whatever reason they want to stay near their human. Sometimes the student is flattered and doesn't try very hard to encourage the dog to play. Other students will try to get the puppy engaged in the group, but in either case the student usually feels at least a bit flattered that the puppy choses them over canine playmates.

All flattery aside, a puppy does need to learn to deal with other dogs in a positive way. Not every dog has to play with every dog it meets, but an "emotionally healthy" dog should appropriately deal with the presence of another dog. The best way to foster this is to allow puppies to play with other puppies in a safe, controlled environment - i.e. a well-run puppy play session. By this I mean puppies are divided according to play style and sometimes by size or age and the instructor is actively involved in preventing bullying, redirecting potentially aggressive play, and praising positive play behavior. Just throwing a bunch of puppies together and letting them go wild for minutes on end is not helpful to any puppy.

Then there are the students who call their puppies out of appropriate puppy-play for whatever reason - usually because they just can't help themselves. Often it's because the puppy is so cute they want to be a part of what's going on. Other times, though, I think if I picked the brain of the student I would find that they can't imagine the thought of their puppy having fun without them - their human - being involved. In other words, the human is jealous. After all, the puppy usually looks to them to have all needs met, especially entertainment. And now that puppy is having fun while excluding the human. That's a tricky adjustment for the human. (And one not every human tries to get over, but that's a different issue...)

Imagine my surprise last night when I found myself experiencing that jealousy. Only instead of calling my dog away from fun and appropriate play so I could be included, it was my 2 year old daughter I was calling away! We attended an indoor-water park birthday party and Bug was having the time of her life. The birthday girl is a 3 year old who is Bug's first good friend and Bug loves to follow her around and copy her. I've been so pleased that Bug has someone her own age to play with since her life is very full of a variety of adults but no one her age.

So why did I keep calling Bug's attention away from her friend and toward whatever I wanted to show her? The best I could figure out is that I was jealous! Yes, part of it was because I am very used to being Bug's Number One playmate, but there was an underlying jealousy factor as well. If Bug has other friends, friends her own age, will she still find me as fun and exciting as she has for the past 2 years? Because it's a big ego boost to be considered as hilarious and entertaining as my daughter considers me.

Once I realized what I was doing to Bug I was able to take a step back and let her interact freely with her friend, as long as what they were doing was safe. Unfortunately the damage was done. Yes, Bug would play with her friend, but she wanted me along as well and would look to me before looking to her friend for the next activity.

Like puppies, children need to interact with others their own age, as well as adults, in order to have the social skills necessary to function in the world. Actually, I'd argue it's more important for children to have playmates and unstructured playtime since they pretty much have to interact with other people as they get older. At least an anti-social dog can be kept away from all other dogs, although that's not much of a life for the dog which is why I advocate puppy socialization as much as I do.

Now I know the error of my ways and will hopefully improve the next time Bug has a play date. It's not easy, but if I love my child, and I truly do, I need to give her some freedom to explore and learn from others her own age. I hope that in the long run it will foster a friendship between us as she becomes an adult. Or at least not send her to the therapist's couch for decades of therapy...