What the doctor ordered
What should an Extension program team have on hand to draft a public value message that secures a skeptical stakeholder's support? Here's my prescription:
What's yours?
What should an Extension program team have on hand to draft a public value message that secures a skeptical stakeholder's support? Here's my prescription:
What's yours?
You know how your Extension programs benefit your participants, but your programs also create public value when they benefit the rest of the community. Nationwide, participants in "Building Extension's Public Value"? workshops have learned how their programs create public value and how to communicate this value to stakeholders whose support is crucial to Extension.
Now, you have an opportunity to learn how to conduct these workshops for Extension scholars at your own institution by participating in an online train-the-trainer program for "Building Extension's Public Value."?
With your registration fee, you get:
• Four hours of instruction in how to conduct "Building Extension's Public Value"? workshops from the creator of the workshops, Dr. Laura Kalambokidis, Associate Professor in the Department of Applied Economics at the University of Minnesota.
• Access to the Building Extension's Public Value Presenter's Guide, the Building Extension's Public Value Workbook, and accompanying Powerpoint™ presentation to download and print for your use in conducting workshops for University and Extension scholars at your institution.
* To register, go here. The registration fee is $100 per participant. To encourage institutions to send teams of staff to the training, the maximum total registration fee for any institution is $500.
* The training will be conducted online, via UMConnect, and will consist of two, two-hour sessions, with all participants attending both sessions. The training sessions will be Monday, March 29, and Wednesday, March 31, 2010, at 2:00-4:00 Eastern; 1:00-3:00 Central; 12:00-2:00 Mountain; 11:00-1:00 Pacific; 9:00-11:00 Hawaii.
* Prior to the beginning of the sessions, participants will receive an email notifying them of how to participate in the two online sessions and how to download the training materials, including the Building Extension's Public Value Presenter's Guide, the Building Extension's Public Value Workbook, and accompanying Powerpoint™ presentation.
* Questions about registration? Contact our help desk at shopext@umn.edu or 800-876-8636.
* Questions about program content and relevance to your work? Contact Laura Kalambokidis at kalam002@umn.edu.
* Other questions? Contact Diane McAfee at dmcafee@umn.edu.
Substantiating the claims that we make about Extension programs' public value is crucial to Extension's credibility. However, we don't always have enough time in a "Building Extension's Public Value" workshop to assemble the documentation (journal articles, program evaluation reports, etc.) to support the claims embedded in a newly drafted public value message. The purpose of the "Research Agenda" workshop module is to list those claims and create a plan for assembling the supporting documents, or even for conducting new program evaluations or research.
Sometimes, a workshop group is torn between wanting to draft a public value message that is persuasive--but, maybe a bit aspirational--and one that contains only claims for which the team has strong supporting evidence. I usually encourage groups to be creative and persuasive during the workshop and worry about the documentation later, but not to publicly use a public value message until they are sure it is defensible. Understandably, this guidance occasionally leads to draft public value messages that include some pretty far-fetched claims.
Cynthia Crawford, Family Financial Education Specialist and County Program Director for University of Missouri Extension in Saline County, MO, has a suggestion for helping workshop groups stay creative while not veering too far off into "aspirational" territory. Cynthia suggests telling teams drafting public value statements that they don't have to have the documentation to substantiate their claims today (during the workshop), but they do have to believe the statements are true today. Cynthia reports that this bit of direction has lead to remarkably strong--and credible--draft public value messages in short amounts of work time.
I will definitely adopt Cynthia's "you have to believe it today" guidance the next time I teach a BEPV workshop. Do you have any other suggestions for helping teams "think big" while staying grounded?
In the Building Extension's Public Value Presenter's Guide, a small-group activity follows the presentation of the various ways a program creates public value. It is a brainstorming exercise, during which groups record as many ways as they can that their program satisfies any of the public value criteria, listed below.
How I handle reporting back at the end of this activity depends on time constraints. If I have plenty of time, I ask groups to report back any number of the ways their program meets any of the criteria. When time is tight, I ask them only to share their reactions to the activity, itself (what worked, what didn't, what questions came up), noting that they will use all of their notes from the exercise later in the workshop.
I tried something different last week when I taught the workshop for LSU AgCenter in Baton Rouge, LA. Instead of asking each table to report, one by one, I went down the list of criteria. First, any group was welcome to share ways their program satisfied the information criterion, next any group could report how their program addressed fairness, etc. This approach takes a bit of time, but I think it might help to break up the workshop structure a little bit.
What do you think? Have you taught the BEPV workshop? Have you tried different ways of having groups report back? Were you at the LSU workshop? How do you think it worked there, aside from the fact that I gave confusing directions to start :-) ?
While the objective of the "Building Extension's Public Value" workshop is to draft a qualitative message about a program's public value, many of our stakeholders are concerned about programs' financial impacts. For example, county commissioners and state legislators want to know how much a program will cost, and whether it's impacts will reduce strain on the county or state budget. A lot of us, therefore, are eager to quantify the impacts of Extension programs and, wherever possible, convert those impacts into dollars and cents.
Some exciting work is being done on monetizing Extension program impacts. These economic impact briefs from Texas AgriLife Extension are a strong example, and I know there are many more studies.
In future blog entries, I'll write more about ways researchers and program evaluators are quantifying and monetizing Extension program impacts. However, as persuasive as a dollars-and-cents case can be with some stakeholders, I can think of two reasons to proceed with caution as we pursue more financial and fiscal impact studies.
First, Cooperative Extension does not yet have all the resources and tools necessary to estimate the financial and fiscal benefits of all of our programs. To do a credible job, applied economists, program evaluators and others would need to devote many more hours to this effort than are currently available. Data must be collected and analyzed, models built and tested, reports written and vetted. The likely result of pressuring program teams to estimate financial impacts while providing them with inadequate resources is a collection of poor quality analyses that erode Extension's credibility.
Second, some programs' public value lends itself more readily to monetization than others. For example, a program that helps reduce a county's cost of managing its waste can make a strong, straightforward, dollars-and-cents case. On the other hand, methodologies for estimating the fiscal impact of social capital improvements are less well-developed.
Because so many of Extension's stakeholders are concerned about monetary value, I am concerned that those programs whose public value is more easily monetized will rise to the top of the priority list--not because they contribute more public value, but because their value is easier to translate into currency.
The objective of the BEPV workshop is to make strong qualitative cases for all Extension programs that create public value. I hope we can keep doing this, even while we seek the resources necessary to estimate the financial and fiscal impacts of those programs for which that is possible.
One of the ways Extension and other outreach programs can build public value is by providing information that allows consumers and business owners to make better choices. In other words, Extension programs help to close the "information gap" that prevents people from doing the best they can for themselves and their businesses.
In the "Building Extension's Public Value" workshop, I caution participants about over-using the information gap as an argument for Extension program funding. All of our programs provide information, but if we try to use a single argument to justify all of our programs, we are unlikely to be successful. I suggest that we reserve the information gap argument for cases where it is likely to be strongest. Which cases are those? I think that when you can answer "yes" to at least some of the following questions, you can make a strong case with the information gap.
Take a look at the fifth question on the list, providing information to people who would not otherwise have access. The variety of ways that Extension programs address access includes providing information at low or no cost, bring programs to geographically isolated areas, giving people materials written in their native language, and delivering information in ways other than through written materials.
At a recent BEPV workshop for the University of Hawaii Cooperative Extension Service, a participant suggested that cultural norms could also create a barrier to accessing and using Extension's information. For example, traditional gender or generational roles might prevent some members of a community from participating in a program. When we identify and address such barriers--indeed, when we allow cultural differences to inform and enrich our programs--we can be more successful in closing the information gap and building public value.
Incidentally, it is not at all surprising that the suggestion to consider cultural norms arose at the Hawaii workshop. Culture is deeply valued by the residents of the 50th state, which has the highest ethnic minority population in the nation. Mahalo, Hawaii, for reminding us to consider both cultural barriers and cultural contributions to Extension programs.
I am continuing to look for ways that the theory of transformative learning--including the disorienting dilemma and perspective change that Mezirow (1) included as elements--applies to the "Building Extension's Public Value " workshop. One of the ways we try to encourage a perspective change for workshop participants is by setting up the free market ideal...and then knocking it down, or at least identifying its limitations. Hopefully we create a disorienting dilemma for someone who has bought into that free market ideal.
For someone who is confident that there is a private-enterprise-driven, government-hands-off solution to every condition that challenges a community, it's hard to see a role for publicly-funded outreach programs. But, once that person understands that free markets and private businesses alone can fail to lead to ideal outcomes, she can see that there is room for the public sector to act to improve those outcomes. Outreach programs in general, and Extension programs in particular, are one way the public sector can take action. (Recall that the "Public Value of Public Programs" workshop makes the same kind of case for outreach education that is sponsored by local governments and non-profits.)
I presented this argument, and the above slide, last week when I guest lectured in the "Transforming Public Policy" (PA 8001) course in the Hubert H. Humphrey Institute of Public Affairs, here at the University of Minnesota. A student challenged me by saying that she didn't see the point of my illustrating the limitations of the free market argument because she didn't believe it in the first place. She started from the perspective that the public sector has a role in addressing market failure, and so didn't need to make the transformation I was advancing.
Surely, this is often the case: that the audience for the BEPV workshop (Extension professionals) is made up of people who fully grasp the limitations of the market ideal. That's why they work for Extension in the first place! But, the above illustration is really intended to help BEPV participants to view the world from the perspective of a stakeholder who is skeptical about public sector involvement in the economy: someone who highly values the role of private enterprise. Hopefully, BEPV participants will then be better positioned to make their case for Extension to that skeptical stakeholder, perhaps by setting up the disorienting dilemma and inducing a perspective change in them.
(1) Mezirow, J. (Ed.). (2000). Learning as transformation: Critical perspectives on a theory in progress. San Francisco: Jossey-Bass.
One of the tenets of Jack Mezirow's theory of transformative learning (1) is a change in perspective triggered by a disorienting dilemma--an event or observation that causes the learner to question her prior assumptions. Being introduced to someone else's perspective can be part of that dilemma. Consider, for example, a rancher and a wildlife conservationist working together in a community group to develop a consensus plan for managing a local population of wolves. Challenged to critically reflect on their own assumptions and to understand others' perspectives, their own perspectives may "transform."

I can imagine that in some cases an Extension program succeeds in encouraging a participant to make a different choice than she otherwise would have by helping her see the perspective of the community-member her actions affect. Letting a homeowner see how her poorly managed septic system turns her neighbors' drinking water toxic could be enough to induce her make a fix. Simply learning the impact of her actions on others--whether beneficial or costly--could be enough for her to make different choices.
In other cases, the perspective change might be a change in the way the participant sees how her actions affect herself, her family, or her business. She may make an alternative choice, not because she is concerned about her impact on the community (her public benefits or costs), but because she wants to improve her own or her family's well-being. As long as these changes also benefit the greater community, she is--however unintentionally--creating public value.
As a final thought on perspective change, I note that Extension educators who participate in a "Building Extension's Public Value" workshop are asked to assume the perspective of a stakeholder--someone whose support for the Extension program is valued, but who is not a program participant. For example, a stakeholder for an out-of-school-time program might be a school board member, who does not have children of his own in the program. BEPV workshop participants are asked to imagine what matters the most to the stakeholder: to put themselves in his shoes. For the school board member, a primary concern might be Kindergarten readiness or student performance on standardized tests. The public value message directed to that stakeholder, then, takes into consideration his perspective and addresses concerns. In so doing, the public value message should be successful in securing his support for the program. It's a case of transformative learning (through perspective change) on the part of the Extension professionals, themselves.
(1) Mezirow, J. (Ed.). (2000). Learning as transformation: Critical perspectives on a theory in progress. San Francisco: Jossey-Bass.
The public value approach to securing support for Extension holds that public value arises when program participants adopt behaviors--make choices--that benefit others. The key to maximizing public value is to design educational outreach programs that increase the incidence of beneficial behaviors. But, how to do this? How can--and do--Extension programs help participants make choices that are different from what their prior experiences and perceptions would lead them to choose?
Nancy Franz, in a 2007 Journal of Extension article, "Adult Education Theories: Informing Cooperative Extension's Transformation," suggests that one route to behavior change is through Jack Mezirow's theory of "Transformational Learning"(1). Franz writes:
"Adult education theories of transformative learning and critical reflection are especially pertinent to inform successful transformation because they focus on developing more participatory learning. These theories suggest that Extension should create opportunities for learners to experience disorienting dilemmas, critically reflect on their assumptions, and facilitate how to learn not just what to learn." [Emphasis added.]

When Extension educators create the right environments for transformative learning to occur, transformation is more likely to happen, and with it, changes in choices and behaviors. In short, Extension educators can increase their impact--and their programs' public value--by acting as "transformers." As an example, in a more recent JOE article, "Catalyzing Transformation: Conditions in Extension Educational Environments that Promote Change," Franz and team of co-authors assess whether the conditions for transformative learning are present in two cases: Cornell Cooperative Extension agent/specialist work teams and Virginia 4-H camps.
In the first JOE article, Franz repeats Mezirow's ten steps that a "transformative learner" might take (1):
1. Experience a disorienting dilemma
2. Undergo self-examination
3. Conduct a deep assessment of personal role assumptions and alienation created by new roles
4. Share and analyze personal discontent and similar experiences with others
5. Explore options for new ways of acting
6. Build competence and self-confidence in new roles
7. Plan a course of action
8. Acquire knowledge and skills for action
9. Try new roles and assess feedback
10. Reintegrate into society with a new perspective
While none of these steps explicitly says, "Do things differently than they would have done before," it is easy to imagine that exploring options for new ways of acting, planning a course of action, and acquiring knowledge and skills for action could lead to behavior change. Is setting the scene for transformative learning enough, however? Or is there some additional action Extension must take to increase the likelihood that program participants act on their new perspectives?
(1) Mezirow, J. (Ed.). (2000). Learning as transformation: Critical perspectives on a theory in progress. San Francisco: Jossey-Bass.
Those of you working within Cooperative Extension have likely heard about Minnesota Extension's major reorganization and shift to a regional/county program delivery model. I frequently field questions about the shift: Why did Minnesota make the change? How did it happen? What has been the result? How is Minnesota Extension doing now?

I am very grateful that George Morse and a knowledgeable team of co-authors have now published a book, The Minnesota Response: Cooperative Extension's Money and Mission Crisis, that answers these questions and more.

On his blog, "Economics in Cooperative Extension," George Morse explains what the book is about:
"The Minnesota Response explains how Minnesota Extension responded to its mission and money crisis in 2004 with a sweeping reorganization. Breaking with 95 years of tradition, Minnesota Extension shifted from a county based delivery model to a regional/county delivery model. Regionalization, however, is the tip of the iceberg. Several other policies define Minnesota's new approach, including changes in funding sources, degree of specialization of the regional educators, more statewide program teams, development of business plans, increased use of market research, supervision of field educators by program specialists rather than geographic supervisors, and new scholarship and promotion expectations. The Minnesota Response details these policies and reports on their initial impacts on program quality, scholarship, access to Extension, and public support for Extension."
The full citation to the book is: George Morse, Jeanne Markell, Philip O'Brien, Adeel Ahmed, Thomas Klein, and Larry Coyle. The Minnesota Response: Cooperative Extension's Money and Mission Crisis. iUniverse, Bloomington, October 2009. 428 pages.
It is available from amazon.com and barnesandnoble.com in soft cover or hard cover.
Google Books allows you to read some of the book. To find the book easily, enter the full title at the Google Books link. George has also included some excerpts at his blog.
I'd be pleased to hear of your reactions to the "Minnesota Model" and to the book, and I'm sure George would be, too. Feel free to share your reactions in the comment section here (particularly as they relate to public value) or at George's blog.
Many of you use the University of Wisconsin Extension logic model to guide program development and evaluation. Below is my first attempt at mapping the elements of the logic model to a public value message.
The "short-term" or "learning outcomes" in the logic model are a means to achieving the behavior changes and outcomes contained in the public value message. These learning outcomes lead the way to public value--and we must identify and measure them--but they are not the focus of the public value message. A skeptical stakeholder is unlikely to be persuaded of a program's value be hearing that a participant learned or became aware of something. The stakeholder is concerned with what the participant actually did with that knowledge.
What I call "changes" in the public value message are called "intermediate" or "medium term outcomes" in the logic model. What I call "outcomes" are the logic model's "long-term outcomes" or changes in conditions.
It seems to me that public value typically arises from a program's long-term outcomes. In some cases, a program's logic model will already include the outcomes that a stakeholder cares about (public value). In other cases, the public value exercise will tell us which additional outcomes we need to monitor--how we should extend the logic model--in order to substantiate our public value messages.
I believe that the public value approach must work hand in hand with program evaluation: it is through good program evaluation that we are able to make credible statements about our programs' public value.
In the previous entry I wrote about two steps that help close the loop between research and Extension (or engagement): conducting research and conducting program evaluation. When I presented this at Purdue's Scholarship of Engagement workshop, a participant asked how I differentiate between research and program evaluation.

For the purpose of the "closing the loop" diagram, I was thinking of research as applied, scholarly investigation, which may or may not have an intended application to an engagement or outreach program. Really, I was envisioning laboratories and experimental plots.
But I also see many kinds of program evaluation as research; certainly evaluation requires the application of research methods (e.g., cost-benefit analysis, survey data analysis, economic impact analysis). However, it may not be the kind of research that subject-matter scholars (e.g., scientists and social scientists) can publish in their own fields' professional journals. So, I think some program evaluation is research and some research is program evaluation. Am I right? Is there more to the distinction than I am making here?
When I ask Extension professionals to name Extension's strengths relative to other providers of outreach education, the connection between Extension programs and university research inevitably is the the first item on the list. We build on that key strength when we deliver programs that are based on the best research, and the community's needs inform the research agenda: that is, when we close the loop between research and Extension. I focused on this relationship--substituting "engagement" for "Extension"--at the Purdue Scholarship of Engagement Workshop last week.
Here's how I think an Extension team can close that loop: They (or someone else) conduct research that leads to a discovery (knowledge creation) that could help address a condition of concern in a community (middle left box in the diagram). The team designs their Extension or engagement program with a curriculum that is based on the new knowledge, as well as existing best practices regarding program design and delivery (middle box). If the team is truly "engage" with their community partner, then the partner's needs and strengths will also inform the design of the program. The team conducts their program (middle right box) while also collecting data and observations that can be used to inform the research agenda (top box). This way, what is observed and learned "in the field" makes its way back to the lab to influence the direction of future research. The team also implements their program evaluation plan, which helps them evaluate the impact of the Extension or engagement program (lower right box). The results of the evaluation helps them improve the program design (lower middle box), so greater impact will result next time.
Where does public value come into this scheme? I can think of at least two places: First, in the design phase, the team will plan how they expect the program to create public value. What are the expected impacts and outcomes, and how do they create benefits for sstakeholders who are not the program's direct beneficiaries? Second, in the evaluation phase, team members will assess whether those expected outcomes were generated: whether public value was created.
I can think of a few ways a team can increase their success at closing the loop:
*Form a team that includes researchers, Extension educators, and program evaluators.
*Embed the program evaluation plan into program design.
*Develop and implement a plan for collecting observations and data arising from the Extension or engagement program.
*Keep up to date on relevant research developments.
*Plan for steps to take once the program ends (e.g., analyzing data and revisiting the program design).
Do you think closing the loop between research and engagement is crucial? Can you suggest ways to make it happen more systematically in Extension?
Last week I spoke at Purdue University's Scholarship of Engagement Workshop: Making the Case for Promotion. The workshop was a resource for Purdue faculty who devote significant effort to public engagement and need to document the impact of that work for their promotion and tenure cases. My talk was about "Creating Public Value with Scholarship and Engagement," and I'll tell you more about what I presented in a future blog entry.
The existence of a workshop like Purdue's testifies to the emphasis that land grant universities have placed on the "engagement" activities of their faculty and students. Many are striving to be "engaged universities" and to promote the "scholarship of engagement." As someone who works with Cooperative Extension, I wonder about the relationship between Cooperative Extension and "public engagement" as universities now define it. In particular, it seems that land grant universities that want to become more engaged need only look to their own Extension organizations, which have been practicing public engagement since the Smith-Lever Act was signed.

So, what do land-grant universities mean by "public engagement" and does it encompass Extension? (I added the emphasis in the quotes below.)
The University of Minnesota's Office of Public Engagement says:
"Engagement is defined as the partnership of university knowledge and resources with those of the public and private sectors to enrich scholarship, research, and creative activity; enhance curriculum, teaching and learning; prepare educated, engaged citizens; strengthen democratic values and civic responsibility; address critical societal issues; and contribute to the public good."
From the University of Illinois' Office of Public Engagement:
"As a land grant institution the University of Illinois has a long record of commitment to public engagement and to the discovery and application of knowledge to improve and serve the greater society in which we live. Its faculty, staff and students collaborate with external audiences and partners to address the needs and opportunities of society. It is through these partnerships that critical societal issues are embedded into and impact the research and educational missions of the University."
Purdue University's Office of Engagement says:
"Purdue believes in being a good neighbor. Through the Office of Engagement, the university uses its resources to address issues affecting the state's prosperity and quality of life."
Imagining America, whose Project Director for Research and Policy, Tim Eatman, also spoke at the Purdue workshop, explains university engagement this way:
"Our activities are based on the conviction that making universities more civic requires ongoing collaboration with partners in the public and non-profit arenas."
Finally, many public university offices of engagement are modeled after recommendations in the The Kellogg Commission on the Future of State and Land-Grant Universities' third report, "Returning to Our Roots: the Engaged Institution":
"This Commission defines engagement as something that goes well beyond Cooperative Extension and conventional outreach. It even goes beyond most conceptions of public service. Our inherited ideas emphasize a one-way process of transferring knowledge and technology from the university (as the source of expertise) to its key constituents. The engagement ideal is profoundly different; embedded in it is a commitment to sharing and reciprocity. By engagement the Commission envisioned partnerships, two-way streets defined by mutual respect among the partners for what each brings to the table."
Within these definitions, I see two primary objectives for engaged scholars: (1) apply knowledge and expertise to address community needs and promote the public good and (2) work toward this end in partnership with constituencies outside the university. As Tim Eatman said at the Purdue workshop, "engaged scholars are co-creators with their community partners."
While the Kellogg Commission argues that public engagement "goes well beyond Cooperative Extension," it seems to me that contemporary Cooperative Extension--at its best--now goes well beyond traditional, one-way, outreach. By the definitions of the universities themselves, Extension is an example (exemplar??) of public engagement. Is Extension's work viewed this way at your institution? Do you see instances where Extension falls short of the engagement ideal?
(Incidentally, until I started fishing around the Internet, I did not know there was a Journal of Community Engagement Scholarship. Did you?)
At last week's "Building Extension's Public Value" workshop for University of Wyoming (see: cowboy) Cooperative Extension Service (CES), one group drafted a public value message for their land reclamation Extension program. The program provides research-based education on how to reclaim rangeland that has been disturbed by energy extraction. You can read about it here.
As I understand it (and members of UW CES Sustainable Management of Rangeland Resources initiative team will correct me), program participants might include landowners--including energy companies--or reclamation professionals, who do the reclaiming work on the part of landowners. The question arose: Who are the participants, and who are the stakeholders for this program? In particular, when the program participant is the person doing the work to reclaim the land, but s/he is working on behalf of a private landowner, should we direct a public value message to the landowner?
We might think of the private owner of disturbed land as a stakeholder, provided s/he doesn't participate in the educational program. After all, s/he clearly has a stake in the reclamation professional being able to do a good job of restoring the land to its original--or new--use.
In my view, however, the private landowner is not a stakeholder in the public value sense: s/he directly benefits from the program through being able to hire a trained--maybe certified--reclamation professional, possibly at a lower cost than if CES had not contributed to that training. The landowner may even enjoy increased land values.
I think the public value message may be more effectively directed to others--aside from program trainees and the private landowners they work for--who have a stake in the land being restored. Of course, if the disturbed land is public land, the stakeholders are all the residents of Wyoming. At the conference, the group suggested hunters (specifically grouse, I recall), people concerned with biodiversity, and those who value an open viewscape.
What do you think? Who are the stakeholders for a program that trains a group of professionals to perform a service for a family or a business?