This term I've been teaching my last-ever section of Educational Psychology. It's a bittersweet feeling, because I love this class and I love my students and I'm sad to see it come to an end but I'm happy to see what we have achieved together.
One of the best discussions we had was last week, when we were discussing Kohlberg's Theory of Moral Development. Each class period, one of the sections is taught by a pair of students. The students who taught Kohlberg did a great job really breaking down and teaching it clearly. And they used characters from Disney's Robin Hood to illustrate.
Kohlberg's theory in a nutshell outlines the stages people go through in developing moral reasoning. It echoes (and relies a lot on) Piaget's developmental stages, but explains how we grow in our understanding of right and wrong.
Stages 1 and 2 - Preconventional
In this stage, reasoning of right and wrong is based on maximizing personal benefit or avoiding punishment. This is the small child who takes a toy because he wants to play with it (stage 1) or decides not to hit his brother because he is afraid his mother will punish him (stage 2). As my own mother so succinctly phrased it as I was growing up, "Are you sorry you did it or sorry you got caught?" Her question was, basically, "Have you progressed past Kohlberg's preconventional level of moral reasoning yet?" My students illustrated this level with Prince John, the "phony king of England" motivated by the promise of personal monetary gain.
Stages 3 and 4 - Conventional
In these stages, people choose to follow what is right without relying on personal gain, but "right" is determined by authority figures and social conventions and laws. There is a strong sense of right and wrong, but it is very letter-of-the-law. Those who transgress should be punished, and "goodness" is determined by how well someone follows the rules. My students who were teaching used the Sheriff of Nottingham as an example of someone who did what was "right," that is, followed the inhumane laws put forth by Prince John, but wasn't reasoning on the level of what was right for the people who were suffering because of the unjust taxes.
Stages 5 and 6 - Postconventional
In these stages, right and wrong are based on social contract and universal human values. This is the realm of the Martin Luther Kings, the Gandhis and the Jesus Christs. Christ taught people who were still reasoning in the conventional stages, offering them challenges such as "The sabbath was made for man, and not man for the sabbath." and "He that is without sin among you, let him first cast a stone at her." The person who has developed postconventional moral reasoning understands and respects the rule of law but acknowledges a higher level of right and wrong that is sometimes not effectively addressed by the law. In my students' example, of course, this was illustrated with Robin Hood.
There are criticisms of Kohlberg's theory of course; it's not perfect, and it definitely isn't an iron-clad pronouncement of human destiny, but it's helpful and so far has shown to be backed up pretty well, at least in its broadest implications, by research.
This led to an interesting conversation in class, however. A few of my students had taken another class in which the teacher said that people also criticise Kohlberg's theory because it relegates religious people to the conventional stages. I'm not quite sure, because it was second hand, whether this teacher himself thinks that religious belief falls within the conventional stages and thinks that the theory is incomplete because of that, or if he was reporting that other people believe that religion impedes moral development. I did a little searching and found a blog post arguing the latter. (I left a rebuttal on that post; if the author does not approve and post it, I'll post it for you here.) But one of my students was puzzled by these different reports and asked me flat out "So is this theory compatible with religion?" So I turned it back to them. "What do you think? What does your religion teach about morality and how does that work with Kohlberg's theory?"
My students then came up with examples of the Robin Hoods of our religion - individuals who had seen the necessary good based on universal principles that needs to trump the laws of man from time to time. Jesus and the woman taken in adultery, Nephi and Laban, Martin Luther King's peaceful protests. These were all actions taken in the name of religion that transcended dogma. And so our class came to a pretty general consensus that though religion can be very diverse and some people may rely on it as a set of unquestionable rules and regulations, there are many examples of times when we need to do what is right even though it appears on a certain level to be "wrong."
It's a delicate line that moral individuals have to tread. There is a delicate balance in being a lawful individual and yet being true to one's conscience. This is why the moral dilemmas that Kohlberg used in the experiments to form his theory are called "dilemmas." Because they're tricky, thick situations that are not answered easily with an appeal to rules. They happen in politics all the time. They happen in religion all the time. As a missionary, one of the lessons I taught people was about following the laws of the land. Latter-day Saints believe in being law abiding citizens, I taught. The Church university I attend publishes posters encouraging students not to download pirated music, it's that important of a concept. Cut and dried, right? Being moral means you follow the laws in spite of personal convenience. That's what's moral. But then I taught the concept to Jenny, from China. We were at the end of the lesson when she asked "I understand that it's important to follow the laws, but what if I went back to China where the law says I can only have one child? I already have one, so I would have to have an abortion if I became pregnant again. But we also believe that abortion is wrong. So do I follow the law or not?"
It was not an easy question. Moral dilemmas are not easy questions. Operating at the postconventional stages of moral reasoning is not an easy task that can be resolved with a quick appeal to the rules book. That's what makes being moral a challenge, and that's why different people will have different answers. That is totally in line with the types of decisions truly religious people have to make every day.
And then, just a few days later, a ruckus came up in the Salt Lake City newspapers. The LDS Church - one of those religious organizations long criticized for being simplistic and dogmatic and limiting the moral development of its followers - had publicly endorsed the Utah Compact, a plan to deal with illegal immigration that erred on the side of compassion for immigrants. The church released a statement stating that it discouraged illegal activity but that some sort of solution for those who have broken the law but have little recourse should be found. The Church itself made a moral decision based not on the harsh black and white requirements of society's laws and regulations but on the idea of a social contract and on larger, universal, concerns for what is right and what is humane. This was a religious organization promoting a Stage 6 solution.
Part of quelling the debate on religion and morality is by turning the issue back to the individual. Moral decisions are individual decisions. Religion does not impede moral development any more than being on the soccer team impedes moral development. Our social context is full of various levels of authority figures and teachings of every sort. When people outsource their own decision making responsibility to anyone or anything - whether it be a religion, an organization, or the consensus of popular culture and media - they are operating on a conventional level of moral reasoning. But when people from any religious or ideological background make a choice based on their own reasoning and faith, in spite of competing systems of belief around them, with the good of others in mind, they are making a moral choice from a higher level of moral development. And even if you disagree with that choice, you can't disagree with their freedom to make it.
Tuesday, June 14, 2011
Tuesday, April 13, 2010
2 Sigma in Summary
Today one of the guys from my apartment complex made the mistake of walking with me on my way to campus. No, that wasn't the mistake. The mistake was when he asked me "So, I have a question about pedagogy in general. How do you balance the needs of an individual learner with the needs of our programs and the demands of giving everyone a free public education?"
I then unloaded the entire 2 Sigma arsenal on him and he was saved only by our merciful arrival at our destination and need to part ways.
But now that I think about it, I think maybe that's one of the key issues here, and where it will be most helpful for 2 Sigma research to take us.
The real Question: how do we address the needs of an individual learner in a group setting?
Things I've learned this semester that I would say answer or at least hold promise for answering that question:
1. Mastery learning. No, really. How do we effectively implement mastery learning in our current system? OR, how drastically can we get away with re-vamping the current system (like, maybe assassinating Nickleby?) to accommodate mastery learning systems?
2. Computer mediated instruction. I don't want to say "computer instruction." I think we've learned that robot tutors don't work. But I think there is great potential for humans in robot skins, like the Open High School. According to Willingham there is a fundamental difference between humans and computers: computers can beat any human in chess; however, they can't walk. They can only perform in a totally predictable environment. What makes a human a human is the feedback-feedforward capabilities that cannot be programmed. And that's the key to a tutoring environment and why it can't be automated.
3. Pedagogical approaches - the Zone of Proximal Development. The real question here is how to implement what we already know is pedagogical best practice. How do you monitor where every student in your class is and where they have the potential to be? This is what my Ed Psych students ask me every week. And it's what we still need to solve.
I'm excited about the challenge here - I think there really is the potential to change the way our students are expected to learn and I think we really need to hold ourselves accountable for making sure students aren't slipping through the cracks. がんばります!
I then unloaded the entire 2 Sigma arsenal on him and he was saved only by our merciful arrival at our destination and need to part ways.
But now that I think about it, I think maybe that's one of the key issues here, and where it will be most helpful for 2 Sigma research to take us.
The real Question: how do we address the needs of an individual learner in a group setting?
Things I've learned this semester that I would say answer or at least hold promise for answering that question:
1. Mastery learning. No, really. How do we effectively implement mastery learning in our current system? OR, how drastically can we get away with re-vamping the current system (like, maybe assassinating Nickleby?) to accommodate mastery learning systems?
2. Computer mediated instruction. I don't want to say "computer instruction." I think we've learned that robot tutors don't work. But I think there is great potential for humans in robot skins, like the Open High School. According to Willingham there is a fundamental difference between humans and computers: computers can beat any human in chess; however, they can't walk. They can only perform in a totally predictable environment. What makes a human a human is the feedback-feedforward capabilities that cannot be programmed. And that's the key to a tutoring environment and why it can't be automated.
3. Pedagogical approaches - the Zone of Proximal Development. The real question here is how to implement what we already know is pedagogical best practice. How do you monitor where every student in your class is and where they have the potential to be? This is what my Ed Psych students ask me every week. And it's what we still need to solve.
I'm excited about the challenge here - I think there really is the potential to change the way our students are expected to learn and I think we really need to hold ourselves accountable for making sure students aren't slipping through the cracks. がんばります!
Tuesday, March 30, 2010
The silver bullet: ZPD!
Spend a few hours in the Ed Psych class I teach, you could easily get the misconception that Vygotsky's Zone of Proximal Development is the correct answer to everything. And you might, I'm afraid, almost be right. "Brush your teeth. Go to church. Zone of Proximal Development."
Today this came up in our discussion of the 2 sigma problem - what makes a difference in a tutoring environment? Maybe it's as basic as the inability for the teacher to simultaneously correctly ascertain the proper zone of proximal development for 30 students. Maybe a tutor, even a peer tutor, is effective because it's an adaptive, responsive human with the feedforward-feedback adaptive abilities to both evaluate your current level and present information at the level slightly above. Maybe a robot teacher (computer program) is ineffective because there's no way we can program in enough variables (constantly changing variables at that) to provide the necessary context for intelligent decisions that enable scaffolding.
But what about the web? Jared asks. Does the web enable us to scaffold ourselves?
For motivated students, yes, Jon says.
But I argue that the web is not an entity, not a robot teacher - the web is just a really easy way to get to other human beings. The web is a tool to enable scaffolding... but there has to be a human on the other side somewhere.
So what does this mean for us now? The discussion came back to our good old friend Mastery Learning. Mastery Learning! Which is only really possible when someone knows if you've really learned - if someone alive and responsive can go through those processes with you, they're providing that scaffolding feedback.
So is the ZPD our silver bullet? Is mastery learning our silver bullet? Are ZPD and mastery learning really kind of the same thing? Do I get any extra points for brushing my teeth and going to church? Interesting things to keep in mind...
Today this came up in our discussion of the 2 sigma problem - what makes a difference in a tutoring environment? Maybe it's as basic as the inability for the teacher to simultaneously correctly ascertain the proper zone of proximal development for 30 students. Maybe a tutor, even a peer tutor, is effective because it's an adaptive, responsive human with the feedforward-feedback adaptive abilities to both evaluate your current level and present information at the level slightly above. Maybe a robot teacher (computer program) is ineffective because there's no way we can program in enough variables (constantly changing variables at that) to provide the necessary context for intelligent decisions that enable scaffolding.
But what about the web? Jared asks. Does the web enable us to scaffold ourselves?
For motivated students, yes, Jon says.
But I argue that the web is not an entity, not a robot teacher - the web is just a really easy way to get to other human beings. The web is a tool to enable scaffolding... but there has to be a human on the other side somewhere.
So what does this mean for us now? The discussion came back to our good old friend Mastery Learning. Mastery Learning! Which is only really possible when someone knows if you've really learned - if someone alive and responsive can go through those processes with you, they're providing that scaffolding feedback.
So is the ZPD our silver bullet? Is mastery learning our silver bullet? Are ZPD and mastery learning really kind of the same thing? Do I get any extra points for brushing my teeth and going to church? Interesting things to keep in mind...
Tuesday, March 23, 2010
Robot Teachers
Class notes: where have we gone with this 2 sigma question this semester?
What I want to know is: are computers really the answer? Do we believe that? It seems that's where all the research has gone ever since Bloom's 1984 article - we automatically assumed "Well, that's easy. We'll make robot teachers."
Which means, of course, that the science fiction authors were all right! Right?
Do you like my disturbingly gross over-simplifications? That's actually my only talent here.
Dr. Wiley's first topic - Anderson's work in intelligent tutors. "Reflctions of the Environment in Memory" - Anderson and Schooler - basically, frequency, recency and pattern determine what we keep in our memories and what we throw away. Because this is the way our environment is structured, this is the way our brains have decided to store information. Very interesting.
So what does this have to do with robot teachers is what I want to know. Oh good, he's getting there.
Carnegie Mellon's Open Learning Initiative - uses "mini cognitive tutors." A study shows that students who use these online tutorials in hybrid mode learn faster and better than students in face-to-face classes. My next question, though, is - how do the hybrid students do compared to the online-only students? And this is where I think the sci-fi authors really missed the mark.
What did they think we'd have by the year 2010? Robot teachers, right? Automated teaching machines. Computers that talk to you and ask you questions. Pills that taste like food so you don't have to eat. We don't have any of that, though, do we? We failed! But what do we have? We have Wikipedia. And Omega-3 enriched eggs.
Here's what I say, though - Wikipedia is way cooler than robots. We outdid the sci-fi authors. Why? Because computers are dead and lifeless and can't simulate the human brain. But when you put the human brain - no, 153 million human brains - in computer skins, then they can do cool things. The hybrid is doing things that the machines will never do.
OK, off of the tangent train. Back to class:
The Open High School (Dr. Wiley's specialty) - There are two things a tutor does: 1. information provision (broadcast function), 2. Q/A, diagnostic help, support
#1 is automated - one teacher writes one lecture, makes it available online, rather than giving 6 lectures. #2 is partially automated in terms of data analysis, who's doing what, etc., the actual teacher is doing the 1-on-1 connection
Again - the hybrid human/machine is doing more and doing it better than a human alone or a machine alone can do. This is fun! Class is over though. Remind me to come back to this.
(Get your robot teacher to send me an email or something)
What I want to know is: are computers really the answer? Do we believe that? It seems that's where all the research has gone ever since Bloom's 1984 article - we automatically assumed "Well, that's easy. We'll make robot teachers."
Which means, of course, that the science fiction authors were all right! Right?
Do you like my disturbingly gross over-simplifications? That's actually my only talent here.
Dr. Wiley's first topic - Anderson's work in intelligent tutors. "Reflctions of the Environment in Memory" - Anderson and Schooler - basically, frequency, recency and pattern determine what we keep in our memories and what we throw away. Because this is the way our environment is structured, this is the way our brains have decided to store information. Very interesting.
So what does this have to do with robot teachers is what I want to know. Oh good, he's getting there.
Carnegie Mellon's Open Learning Initiative - uses "mini cognitive tutors." A study shows that students who use these online tutorials in hybrid mode learn faster and better than students in face-to-face classes. My next question, though, is - how do the hybrid students do compared to the online-only students? And this is where I think the sci-fi authors really missed the mark.
What did they think we'd have by the year 2010? Robot teachers, right? Automated teaching machines. Computers that talk to you and ask you questions. Pills that taste like food so you don't have to eat. We don't have any of that, though, do we? We failed! But what do we have? We have Wikipedia. And Omega-3 enriched eggs.
Here's what I say, though - Wikipedia is way cooler than robots. We outdid the sci-fi authors. Why? Because computers are dead and lifeless and can't simulate the human brain. But when you put the human brain - no, 153 million human brains - in computer skins, then they can do cool things. The hybrid is doing things that the machines will never do.
OK, off of the tangent train. Back to class:
The Open High School (Dr. Wiley's specialty) - There are two things a tutor does: 1. information provision (broadcast function), 2. Q/A, diagnostic help, support
#1 is automated - one teacher writes one lecture, makes it available online, rather than giving 6 lectures. #2 is partially automated in terms of data analysis, who's doing what, etc., the actual teacher is doing the 1-on-1 connection
Again - the hybrid human/machine is doing more and doing it better than a human alone or a machine alone can do. This is fun! Class is over though. Remind me to come back to this.
(Get your robot teacher to send me an email or something)
Tuesday, March 2, 2010
Where should we go from here?
Create a research agenda for creating a tutor-like environment for education. Where should our attention be placed? What tools are emerging that we could use to give people access to something even better than an individual tutor?
I'm still torn on what the main focus is here. It seems like, of the literature we've seen, most has been focused on technological solutions to the 2 Sigma Problem. This is good, but in a lot of the subsequent literature in the 90s we pursued technological replacements for the tutor, which ended up as rather fruitless searches.
What I want to know is: why didn't more research follow the mastery learning thread that Bloom himself started? Mastery learning was far more effective than anything else at approaching the 2 sigma level, but we seem to have given up on that option and instead focused on what we can do to make a computer act like a human being. Why on earth would we abandon the most promising pedagogical approach? Well, I mean apart from the fact that it is totally incompatible with the No Child Left Behind approach to education where we divide up learning into totally inauthentic and arbitrary chunks and proscribe an approach to teaching that is not only frustrating for the teachers but entirely contrary to everything we know as best practice; other than that, of course, why would we do this?
I appreciated the Chi, et al. study that sought to find out what about the tutoring experience made it effective. Its findings suggested that it isn't the tutor's bank of knowledge that makes a difference, (the "suppressed tutoring" was just as effective as "normal" tutoring) but rather the structure; the interactive environment that is making a difference.
So what I want to see us do is to explore the pedagogy of tutoring and find out how to change our classroom structures to better replicate it (or tear down the classrooms altogether). Especially in an age where internet technology allows access to information that a "sage on the stage" didn't need to memorize, we have such a capacity to change the way we teach and learn. Web 2.0 and communicative technologies allow us to extend the reach of the human tutor and the interactive environment. Instead of trying to figure out how to make computers think like humans, let's try to use our computer technology to increase the capacity and number of human tutors.
I'm still torn on what the main focus is here. It seems like, of the literature we've seen, most has been focused on technological solutions to the 2 Sigma Problem. This is good, but in a lot of the subsequent literature in the 90s we pursued technological replacements for the tutor, which ended up as rather fruitless searches.
What I want to know is: why didn't more research follow the mastery learning thread that Bloom himself started? Mastery learning was far more effective than anything else at approaching the 2 sigma level, but we seem to have given up on that option and instead focused on what we can do to make a computer act like a human being. Why on earth would we abandon the most promising pedagogical approach? Well, I mean apart from the fact that it is totally incompatible with the No Child Left Behind approach to education where we divide up learning into totally inauthentic and arbitrary chunks and proscribe an approach to teaching that is not only frustrating for the teachers but entirely contrary to everything we know as best practice; other than that, of course, why would we do this?
I appreciated the Chi, et al. study that sought to find out what about the tutoring experience made it effective. Its findings suggested that it isn't the tutor's bank of knowledge that makes a difference, (the "suppressed tutoring" was just as effective as "normal" tutoring) but rather the structure; the interactive environment that is making a difference.
So what I want to see us do is to explore the pedagogy of tutoring and find out how to change our classroom structures to better replicate it (or tear down the classrooms altogether). Especially in an age where internet technology allows access to information that a "sage on the stage" didn't need to memorize, we have such a capacity to change the way we teach and learn. Web 2.0 and communicative technologies allow us to extend the reach of the human tutor and the interactive environment. Instead of trying to figure out how to make computers think like humans, let's try to use our computer technology to increase the capacity and number of human tutors.
Friday, February 26, 2010
Tuesday, January 26, 2010
What's Actually Happening in a Tutoring Environment?
So, given that we're wanting to simulate human one-on-one tutoring, or get as close as we can to it to achieve the 2-sigma effect, what is it about the tutoring experience, exactly, that we want to replicate?
So far, the Chi article has been the most compelling for me.
So it's not the tutor as a repository of knowledge that makes a difference. It appears, on the surface at least, that it doesn't even matter how much the tutor knows. A student can still excel when paired with a tutor who doesn't provide answers but does provide questions - provides an interactive platform on which students can construct their own knowledge. (Did I just say "construct their own knowledge?" Dangit. That's one of those cliché phrases I promised never to say.)
I found two other articles that report on an AI tool called AutoTutor which attempts to replicate actual human tutoring.
"We discussed three projects that have several similarities. AUTOTUTOR, ATLAS, and WHY2 all endorse the idea that students learn best if they construct knowledge themselves. Thus, their dialogues try to elicit knowledge from the student by asking leading questions. They only tell the student the knowledge as a last resort."
While I don't know that AutoTutor really does a very good job of creating an opportunity for students to construct knowledge themselves, there is still the assumption that what's really going on here doesn't have as much to do with the tutor as it does with the student. The reason students flourish in a one-on-one environment is because of the student half of the one-. The student needs to be questioning, interacting, involved. So does it matter who's on the other side of the table?
Is this just, then, a pedagogy question? I'm increasing tempted to think it is.
So far, the Chi article has been the most compelling for me.
Chi, Michelene et al (2001). Learning from Human Tutoring. Cognitive Science 25, 471-533 (Here's a link to the PDF)This study used a control group with no tutoring, a group receiving normal tutoring, and a group that received "suppressed tutoring" in which the tutors did not provide information and answers but did still provide an interactive environment. The students who received suppressed tutoring still progressed just as well as those who received normal tutoring.
So it's not the tutor as a repository of knowledge that makes a difference. It appears, on the surface at least, that it doesn't even matter how much the tutor knows. A student can still excel when paired with a tutor who doesn't provide answers but does provide questions - provides an interactive platform on which students can construct their own knowledge. (Did I just say "construct their own knowledge?" Dangit. That's one of those cliché phrases I promised never to say.)
I found two other articles that report on an AI tool called AutoTutor which attempts to replicate actual human tutoring.
Graesser, A., Wiemer-Hastings, K., Wiemer-Hastings, P., Kreuz, R., & the Tutoring Research Group. (2000). AutoTutor: A simulation of a human tutor. Journal of Cognitive Systems Research, 1, 35-51.The articles don't report any sort of testing on the tool and, quite frankly, I remain rather dubious after reading them, but they do bring up one interesting point that goes along with this train of thought.
Graesser, A., VanLehn, K., Rosé, CP., Jordan, PW., Harter, D. (2001). Intelligent tutoring systems with conversational dialogue. AI Magazine, 22(4), 39-52. (Here's a link to the PDF)
"We discussed three projects that have several similarities. AUTOTUTOR, ATLAS, and WHY2 all endorse the idea that students learn best if they construct knowledge themselves. Thus, their dialogues try to elicit knowledge from the student by asking leading questions. They only tell the student the knowledge as a last resort."
While I don't know that AutoTutor really does a very good job of creating an opportunity for students to construct knowledge themselves, there is still the assumption that what's really going on here doesn't have as much to do with the tutor as it does with the student. The reason students flourish in a one-on-one environment is because of the student half of the one-. The student needs to be questioning, interacting, involved. So does it matter who's on the other side of the table?
Is this just, then, a pedagogy question? I'm increasing tempted to think it is.
Subscribe to:
Posts (Atom)