Amy Potthast | Instructional Coach & Designer | Learning Design Studios

To design a professional development training program for Emerging Practitioners in Philanthropy, I wanted to follow the outcomes-based instructional design practice of convening subject matter experts as a starting point.

In-person affinity groups

Ideally, the designer brings together subject matter experts who represent diverse perspectives on the training topic. The experts brainstorm, share, and group answers to the question, “What do participants need to be able to do, out in the real world, as a result of the training program?”

Each expert writes their responses on sticky notes, introduces each note to the group, and post it to a wall. After the experts have all spoken, they come together to compare and group their responses.

Throughout, the designer challenges the experts to focus on action statements — and to avoid verbs such as “to understand” and “to know.”

From each cluster, the designer and experts wordsmith a first draft of an outcome statement, something like: “As a grant maker, evaluate the financial workings of current and prospective grantees.”

Affinity groups at a distance

Because the EPIP subject matter experts lived across the country from each other, I had to sort out a different way to run the affinity process.

George Reese, of Gateway to College National Network, and my instructional design professor at Oregon State, consulted with me about the process (even though our term together had ended). He recommended connecting with SMEs one-on-one or in small groups over the phone, rather than try to convene them as a group.

So this is what I tried. Each chat was about an hour long. I took notes on Google docs and shared them  with each expert afterwards, asking them to correct or clarify.

Once the experts had confirmed the notes, Russ and I grouped them, and I drafted outcomes — referring to the rubric from class as a job aid. I also looked at survey results from EPIP members, where they reflected on what kind of professional development they wanted.

Then I met with Russ Finkelstein, my partner on this project, to look through the outcomes and make sure they adequately reflected the notes. Russ is a coach at EPIP and my former boss at Idealist.

Once we finalized the outcome statements, we brainstormed a list of workshops that might be appropriate in the training program.

Next steps

Right now, EPIP staff and chapter leaders are looking at our long list of workshop topics to decide on 6-8 they’d like us to create. We’ll work on the first four of this this spring — an onland and online version of each.

 

This content is password-protected. To view it, please enter the password below.

Tonight I drafted Section One of the Constructivist Paper. That it is a draft is a wee bit confusing to me, because I am not clear how complete it needs to appear. Do I need to include all my references to date formatted in APA? Wouldn’t I rather keep researching rather than pause a moment to write up my findings to date? (Yes!)

I feel that I can say more about what I did not learn and how I will not be using my findings, than how I will use the learning. I did not learn whether I enjoy constructivism as an instructor; I didn’t facilitate students through a learning contract.

Also, to answer the question about what I had learned from each resource, I used a table to organize the information. On the one hand, that is a graphic organizer in and of itself, though it goes on for too many pages! But also, do I need more of a narrative introduction to the table? And currently the table is organized chronologically by when I encountered the resource, rather than by alphabetical order of the source.

 

In Annual proceeedings of selected research and development [and] practice papers Presented at the National Convention of the Association for Educational Communications and Technology. Vol. 1-2. p. 259-264

This morning I read a paper from 2001 examining the implementation of a mandatory elementary school mathematics reform in Taiwan that took place in 1996-ish. Apparently, it’s come under a lot of criticism, but not related to student outcomes (at least that is not addressed in this paper). The criticism comes more from issues related to how the reform was implemented — not enough stakeholder buy-in, even from among the teachers expected to change their teaching methods.

Some useful information here relates to conducive environments:

1) Instructors must buy-in to implementing constructivist courses and programs. In the Taiwan example, teachers weren’t part of the impetus for reform; apparently many teachers opted to retire early rather than change their methods and others kept teaching using objectivist approaches. I don’t know what the impact on student outcomes the lack of buy-in has had, but surely the students of these teachers did not succeed within constructivism which is my research question.

2) Schools should apply constructivist ISD approaches widely, not related to a single academic subject area. In the Taiwan example, the author argues that educational leaders did not view the mathematics reform as related to the need for systemic transformation, but was part of a piecemeal “attempt to improve fragmented and outdated educational reforms.”

One source the author cites is Chung (1997) — Chung reviewed student outcomes after the constructivist reform — but his/her study comes from an in-service training for Taiwanese teachers, and is in Chinese. Although I read Chinese (better at simplified Chinese that’s common on the Mainland), I don’t know that I’d be able to locate the article though I would love to see what Chung found.

The final useful thing I learned about was the “Major Guidelines for the Redesign Process” developed by Reigeluth, Norris and Ryan which the author applies (in retrospect) to review the Taiwan reform. If I can find it, it might be useful to learn what are good practices in general, not related specifically to constructivism. It was published in a report from the Indiana University School of Education so may not be easily available.

Wu, Y.S. (2001). Systems design: An analysis of the implementation process of Taiwan’s constructivist approach elementary mathematics curriculum. In Annual proceeedings of selected research and development [and] practice papers (1-2), (259-264).

Reading: Allen, M. (2008). Promoting critical thinking skills in online information literacy instructions using a constructivist approach. College and Undergraduate Libraries, 15 (1-2) 21-38.

So from the abstract I could extrapolate that the author presumes that more constructivism champions a more active learning style than students are accustomed to from “traditional” approaches.

Conducive environment…
On page 31, Allen argues that, “in order to provide a true constructivist-based learning environment, instructors and instructional designers must plan carefully from the beginning of the instruction to the end.”

On. p. 33 she continues, “creating true constructivist-based instructional materials and online learning environments can be difficult, time-consuming, and not warranted in every situation” (see below for more detail)…

p. 33, quoting Bostock (1998): “A radically constructivist course would be more difficult to implement within the constraints of large numbers, resources, and institutional culture, so it is cheering to think that a partial implementation of constructivist principles may actually be optimal for the majority of students.”

Students who succeed…
Allen compares solving complex, “ill-structured” problems as one of the core principles of constructivist learning. “This type of problem, conceived of by the instructor or designer, may be a case study, scenario, or ultimate desired goal statement that provides the learner with important component information, but offers no direction and no obvious solutions to the stated problem. The use of the ill-structured problem is typically used in instructional settings where the learner already possesses a great deal of prior knowledge. The the learner must use his or her previous skills and apply them to the proposed situation to formulate a plausible solution” (pp. 31-32) — italics are mine.

On p. 33 she continues, “In environments where students are so inexperienced that they have very little prior knowledge to build upon, a constructivist-based approach would likely overwhelm them.”

The latter quotations reinforce my sense that students who succeed within constructivism have prior experience with the subject matter or processes required to answer their research questions.

She writes, “some learners simply do not thrive in a constructivist environment. As Bostock observes, ‘Some students will enjoy the challenges of constructivist learning while others will sometimes find them uncomfortable and need more objectivist instruction.”

I will look up Bostock; I wish Allen were more specific about why some students enjoy constructivism and others do not thrive.

Strategies:
On p. 33, Allen says, “It may, in such cases [where students are inexperienced], be more advisable to provide a more straightforward, objectivist approach….”

on p. 33, quoting Cooperstein and Kocevar-Weidinger: “Designing suitable activities requires careful planning and greatly increases preparation time. Finding perfect examples and problems that will lead students to an appropriate ‘Aha!’ experience is difficult requires a great deal of intense, time-consuming work,” (145).

I searched for the Cooperstein & Kocevar-Weidinger paper through the a couple databases on the OSU library site and couldn’t find it but will look again.

Questions for cohort survey

Thanks for Twodolla from Flickr Creative Commons

Thanks to Twodolla from Flickr Creative Commons

In attempting to answer my questions for the constructivist  assignment, I’m going to survey my classmates about their experiences with the assignment.

  • How would you rate the constructivist assignment (check all that apply)
    • Loved it/had fun with it
    • Tough getting started but I found my stride
    • Struggled with the assignment consistently
    • Did not see the point of it
  • For you, how would you compare your experience in the constructivist assignment, compared to the objectivist assignments we’re more used to? The constructivist assignment was….
    • Easier
    • More fun
    • More interesting/engaging
    • Resulted in more learning
    • Same
    • Harder
    • Less fun
    • Less interesting/engaging
    • Resulted in less learning
  • What challenged you about the constructivist assignment?
  • Were you able to write the learning contract before starting work on the contract?
    • Yes
    • No
    • Not sure
  • What helped you or would have helped you?
  • For you and your development, what were pros of the constructivist assignment?
  • What were the cons?
  • Are you satisfied with the results so far of the project? Did you learn what you set out to learn?
  • In many ways our internships are also constructivist assignments. How would you rate your internship(s)? Check all that apply.
    • Loved it/had fun with it/them
    • Interesting experience
    • Tough getting started (the work, or finding an internship) but I found my stride
    • Struggled with the internship consistently
  • What has challenged you regarding your internship(s)?
  • What has helped you make decisions regarding your internships, or would have helped?
  • How long have you been working in the field of adult education?
  • What’s your GPA so far?
    • 3.5-4.0 (A+)
    • 3.0-3.4 (A)
    • 2.5-2.9 (B+)
    • 2.0-2.4 (B)
    • 1.5-1.9 (C+)
    • 1.0-1.4 (C)
    • Less than 1.0

On TESC campus - from Codiferous on Flickr

Today I drove up to TESC for the CIEL conference (CIEL is the Consortium for Innovative Environments in Learning), a gathering of about 12 schools that have a “progressive” bent in education innovation, according to the webstie — not sure how specific the word “progressive” is… does that actually mean something? Or does it just mean not traditional?

Anyway I had a chance to ask several students about their experiences with learning contracts, and listen in on a few sessions during which I heard faculty and others comment on student-directed learning.

Attributes of successful learning-contract students:

  • Students succeed who are self directed (everyone says this so I asked what does this mean…)
  • Students who know themselves do better.
  • Students succeed who have a gap between high school and college, who have been out in the world working and come back knowing what they want out of a college education. At TESC it’s common for students to be a bit older than at most colleges.
  • Intrinsic motivation.
  • A faculty member from a visiting school said that in “our schools” you [students] bring yourself, your identity, your feelings and passion to the work.
  • Self selection of learning contract opportunities. Dennis (a Masters of Environmental Science student who also did his undergrad at TESC)  said he didn’t see fellow undergrads struggling because contracts were optional, people chose them who wanted to tackle them.
  • Sarah (a grad student in the Masters of Environmental Science program) said she and another student did the exact same internship but she got a lot more out of it while the other kid was going through the motions just to get the credit.

— D. Aubrey and S. Weber, personal communications, Oct. 21, 2011.

How I’m feeling

The trip to TESC was fun. I wish I had taken some time to walk around and look at classroom buildings and such — it was a quick in and out trip during which I sat in on a session about a prison program that the MES program is operating in Washington prisons, and another on the need for/how to integrate social justice in the curriculum.

I met an MES student Sarah who is learning about adult education on her own for her thesis — if she emails I’d like to give her a bibliography of some of my favorite adult ed books to date from our program.

 

Tonight I interviewed Gail and Randee who are program staff for two different grad programs at TESC. Below is what I learned.Who succeeds with constructivist ISD?

  • People who are self-directed, and are goal-oriented related to their own learning.
  • People succeed who are not content to be receptacles of knowledge.
  • Students who choose the constructivist approach succeed (up to 12 credits can be earned through learning contracts, but contracts are totally optional)
  • People who want to learn something outside the school’s offerings succeed because they are driven to independent projects
  • People who plug into objectivist work (i.e. outside study programs or courses) as part of their learning contract

Who struggles?

  • People who are coming straight from undergrad (their programs are grad programs); people whose faculty advisers are not responsive to them (thesis). To succeed in creating a learning contract students must already know a lot

What strategies help?

  • Students work on independent projects and who meet weekly in a class setting with other students, to discuss their progress on projects together, to share strategies, and to learn from each other.
  • Faculty respond to students in a timely manner to keep them moving forward
  • Faculty offer frank, honest, constructive feedback to students on their work to help them improve

Also I emailed instructor an instructor at a constructivist college who works with undergrads with my research questions.

The Evergreen State College in Olympia expects students to take responsibility for their own learning and integrates learning contracts throughout the curriculum. Its website also happens to have a cash of institutional research about admissions and retention trends, student engagement, and other reporting that helps me answer some of my questions.

For example in a fall-to-fall comparison of student retention, it’s clear that the further up the food chain, the higher the retention rates. Grad students’ retention rates are in the upper 80s while first-year undergrads are around 70 percent. (Fall to fall retention 2009-2010). In addition to self-selection (especially at the undergrad level, where retention is stronger as students move towards graduation—- indicating (maybe) that students who are sticking with the school are the ones who are succeeding there. But also the higher retention rates of the relatively shorter-term grad programs makes me think that grad students, ostensibly more mature and more experienced with the content of their studies, have an easier time with independent, self-directed work. So that supports one of my main hypotheses (that more experience with content makes constructivist approaches easier on students).

Another study I read relates to student engagement including observations of a team of outsiders who did a site visit to the school. The report doesn’t go into much detail about who struggles versus succeeds, but it does indicate that some mixed student groupings (i.e. freshman in the same program with seniors) are problematic for faculty because freshman struggle.

The same study describes supports for all students including those who struggle:

  • More support from faculty (for those who struggle)
  • A nine day orientation for all first year students to help them understand TESC’s approaches
  • Informal peer support — learning from other students including those more experienced at Evergreen
Tonight I chatted with Peggy Kelter, a 1978 graduate of Kirkland College in Clinton, NY. Kirkland was women’s college with a constructivist approach.

Peggy said that though she came from a traditional family background (parents educated at Amherst and Smith, e.g.), she thrived at Kirkland because she wasn’t a linear thinker. The professors at Kirkland encouraged students to see the interconnectedness of all they were learning, and she felt that her blinders were taken off when she arrived.

Her final painting project (in lieu of an undergraduate thesis; she was an art major) she designed herself. Initially she had wanted to paint spaces that represented where inside and outside meet, such as windows and doorways. But she said the paintings were just awful. In a rare act of passionate rebellion, she tore up her canvass and found that the small bits of painting were actually good, so she spent the next six months creating full size paintings modelled after the scraps of canvass.

She said that some students at Kirkland struggled. She said they were not self-directed, and some or most eventually came around through the support of the faculty. She said some dropped out because the learning approach was not for them, not structured enough.

She is also a 2003 graduate of the M.A.T. program at Lewis & Clark and now teaches kindergarten in Hood River. She says that in her classroom a constructivist design would not be possible. First, she has 30 children in her room, with no assistance. Furthermore, the children come to school without any experience in school or literacy. Their parents are well intentioned but do not give their children any foundation in reading, for example, by teaching them about the alphabet or reading with them. She says that if you put them in a truly constructivist situation, there would be complete chaos. She says that if you had only 10 of them in a room, a constructivist approach might be possible.

From this interview, I can take away the following insights from Peggy’s perspective:

Students who succeed within a constructivist approach are

  • self-directed
  • systems thinkers
  • not “traditional”
  • have some experience with the context (school) or subject matter (concepts in literacy)

Students who struggle with constructivist design need

  • support from faculty (she couldn’t remember exactly what)

Environments conducive to constructivism include

  • small teacher-student ratio
  • faculty encourage students to see connections