August 31, 2009

First Community and Institutional IPPEs Completed!

This summer, 320 pharmacy students were placed in sites around the state, in the first year of the expanded early experiential education training. Students completing their first professional year spent three weeks in a community pharmacy setting, and students completing their second professional year spent three weeks in institutional pharmacy settings.

The impetus for the expansion was direction from our national accreditation body, ACPE, to provide greater exposure to pharmacy practice settings earlier in the curriculum. Students received evaluations at the end of their rotations. During the fall, evaluations will be collated and assessed for student performance, as well as for indicators for how this new program can be enhanced.

IPPE Facts
• Students were placed in one of five three week blocks
• 161 students were placed in Community sites
• 158 students were placed in Institutional sites
• 12% of community placement and 22% of institutional placement were in areas outside of Duluth and Minneapolis/ St. Paul areas.

Thanks to Camille Kundel, Anne Schullo-Feulner and Chris Jolowsky for their work, with the Committee on Experiential Practice and the Office of Experiential Education, on development of the IPPE competencies and learning activities. Thanks also to all of our preceptors who participated in offering their first Community or Institutional IPPE Rotations!

August 26, 2009

Self Study Approval

At it's August 14th meeting, each section of the self study was presented for discussion and voting. The faculty reviewed several issues raised during the self study process.

Discussion occurred on our position on the merger of the Senior Vice President, Health Sciences and Medical School Dean positions, as well as on our work with capstone assessments. In addition, a review of experiential education progress was presented by Curriculum-Experiential Self Study Group Chair, Tom Larson, along with an update on Experiential Education initiatives, by Senior Associate Dean Charles Taylor.

A few recommendations for changes were made and ratings were affirmed. In addition, the self study visit was discussed.

During the week of August 24th, the Report was reviewed by Senior Vice President Frank Cerra, with a few recommendations made for clarifications of wording. The Report was approved for submission on August 26th.

Thanks to our faculty for their review of the Report in early August and their thoughtful comments at the August 14th meeting. Thanks also to Dr. Cerra's office for their prompt attention to the Report.

July 28, 2009

External Reviewers

The College has included feedback from alumni, preceptors and students throughout the self study process. These important groups have participated through surveys, focus groups, and working groups. Their participation has helped us to identify our strengths and weakness, as well as assisting in setting direction on new initiatives.

In addition to this early, formative participation in the assessment and planning processes, the Self Study Report itself was reviewed by a number of External Reviewers. Our thanks to the following individuals for their participation:

Julie Johnson, Executive Vice President, Minnesota Pharmacists Association Bill Diers, United Hospitals and Past President, MPhA Scott Setzepfandt, Roche and President, Century Mortar Club Joel Amundson, Past President, Pharmacy Alumni Society Pam Phelps, Fairview Health System and Past President, Minnesota Society of Health System Pharmacists Laura Borstad, President, Pharmacy Alumni Society
It was recognized that the quality improvements and issues identified in this document would be moved forward and addressed as part of curricular reform and also the College's strategic planning process. Therefore a "30,000 foot" review of our self assessment by External Reviewers was felt to be important at this point in time. External Reviewers were asked for their comments supporting or clarifying the self assessment ratings and the directions proposed in the Self Study. Reviewers submitted written comments and/ or plan to participate in the August 14 College Assembly Meeting where the self study is discussed and approved.

July 15, 2009

AHC Editorial Support

The Self Study Coordinating Committee would like to welcome the efforts Sara Martin, AHC Public Relations. Ms. Martin will be our editor for the Self Study Report. She will be working to smooth the writing of many individuals into one coherent voice, as well as helping us to control length and create consistency in our formatting. Thanks, in advance, to Sara!

Once the Self Study is submitted. Sara will assist us in preparing several summary documents to assist faculty and students in understanding the highlights of our findings.

July 10, 2009

July 10 Review of Self Study Report

On July 10, 2009, the College Assembly met to review and provide input on the draft of the Self Study Report. Sessions were conducted separately on both campuses. Participants were divided into small groups and spent one hour reviewing and commenting on one section of the self study. A member of the Self Study Committee that was responsible for the section being reviewed, along with a note-taker, was present to facilitate discussion on their section. After one hour, participants moved to a second review group to review a second section of the document.

Three reviews (and lively discussion!) occurred for each of the following:

  • Structure (Mission, Org and Admin)-Standards 1-8
  • Curriculum Didactic #1 - Standards 9-11, 29
  • Curriculum Didactic #2 - Standards 12, 13, 15
  • Curriculum Experiential - Standards 14, 28
  • Students - Standards 16-23
  • Infrastructure (Faculty/Staff and Facilities/Resources) - Standards 24-26 and 27-30

Each group submitted comments, which will be reviewed by the self study groups and incorporated in the next version of the self study. A near final version of the self study is anticipated on August 4 to allow for faculty to review the document before the August 14th College Assembly meeting.

Thanks to the following individuals for their work in preparing, conducting the sessions and for the follow-up communications.

Facilitators: Drs. Cloyd, Johnson, Sorensen, Ranelli, Conway, Larson, Undeberg, Uden, Traynor, Schommer, Schroeder and Janke

Recorders: Fodness, Stouder, Stratton, Palmer, Jolowsky, Sisson, Haeg, Leathers, Hess, Thomas, Gustaveson

Thanks also to the participants. Nearly twenty pages of comments and suggestions were collected and are currently under review by the self study teams!

July 7, 2009

Experiential Updates Available

The Experiential Consultants (see entry on May 4, 2009) have submitted their full report and an executive summary. These reports are now available via the Experiential Education Blog, in addition to information on the reorganization of Experiential Education.

June 18, 2009

Policy Site Launched

In December, the College started a policy initiative to coordinate policy development and dissemination at the College. (See Dec 4, 2009 Blog Entry.) Using a Policy Brief developed by Dr. Erin Sperling (AHC Policy Analyst) a core group was convened to discuss goals. From that meeting, it was determined that:

1) There should be one central person to coordinate the various owners of policy within the college. This person would ensure policies were regularly reviewed, available to those that need them, etc.. In addition, this person should have a backup. 2) A liaison/"owner" should be named in each area for the coordinator to work with. 3) A policy on policy should be created to codify the procedures for proposing, reviewing, updating, revising and withdrawing policies 4) The University's Policy Format was feasible, particularly if movement to this format was completed as policies were up for review.

In completion of items #1 and #2, the College of Pharmacy policy point person and policy owners are:

Point person/coordinator: Fodness
HR: Owens/Cameron
Finance: Thomas
Students: Haeg
Prof Educ Program: Stouder
Communications: Leslie/Carrigan
PPPS: Fosnacht
PCHS: Cremin
ECP: Jenkins
Pceutics: McDermott
MedC: Knickerbocker
Outreach Education: Kast

All new policies are now being developed using the University's Policy Format. In addition, Central Council has reviewed a draft Policy on Policy, which will be completed this fall.

Thanks to all the owners, along with Amy Leslie and Danielle Carrigan for working to centralize our policies onto a policy website, which was officially launched at the June College Assembly Meeting. Suggestions for updates and changes are welcome!

Student Performance Assessment Plan Approved

Also at its July 18th meeting, the College Assembly approved the Student Performance Assessment Plan (SPAP). Based on the College's professional outcomes, the SPAP contains two primary sources of information. Curricular Level Assessments, such as an Objective Structure Clinical Exam (OSCE), are specifically conducted to assess the program's outcomes. Embedded Course Assessments (ECA) are select measures from courses that represent student performance that is isolated and tied to a particular standard (e.g. documenting), as well as directly observed and scored.

The 2008-2009 SPAP contains a variety of types of measures, including measures that have been routinely collected by faculty for years, but not summarized or reported centrally. It also contains new measures that were specifically designed for this plan and conducted for the first time this year (e.g. Public Health Self Assessment).

Each section of the SPAP (e.g. Pharmaceutical Care) represents the College's best evidence of student performance. When collected and triangulated, the measures provide an excellent evidence base for judgment of the learning effectiveness of the curriculum in producing our desire professional outcomes.

Mission Evaluation Plans Approved!

At the June 18th meeting, the College Assembly approved five mission-based evaluation plans, which had been developed under the leadership of the associate deans. The five plans cover:

  • Professional Education
  • Clinical Affairs
  • Service and Engagement
  • Research and Scholarship and
  • Graduate Education

Each of the mission evaluation plans describes its major programmatic outcomes of eachmission. (For example, the Research Plan's programmatic outcome #2 is to "sustain and expand a financially viable and productive research enterprise.") Each outcome is followed by a series of carefully selected metrics (e.g. number of sponsored projects proposals submitted and awarded) designed to measure the achievement of that outcome. The plans also identify the individuals or groups responsible for collection of the outcome data. At the end of each fiscal year, the plans are updated with the year's data and, after consulting with Central Council, targets are set for the next year along with recommendations for action. This process will provide valuable input into annual compact planning.

Thanks to Drs. Taylor, Schroeder, Larson, Mann, Janke and Speedie for their work in shepherding these plans through many discussions and drafts. Thanks also to the departments for facilitating discussion and input on the plans.

May 15, 2009

Curriculum Mapping and Gap Analysis

Many thanks to the Curriculum Mapping Sub-Committee of the Assessment Committee (G. Anderson (Lead), M. Bumgardner, J. Conway, R. Stouder, R. Brown, K. Janke. This group has completed their work for the year. Their achievements include:

  • Completing an assessment of the status of our course maps, collecting any remaining maps that had not been submitted as finalized.
  • Assisting with vendor product evaluations
  • Working with the Office of Professional Curriculum and the Educational Policy and Peer Review Committee to devise a mechanism for ongoing updating of the course maps during the Course Review Process
  • Developing summary maps and analyzing the data on scientific foundation, therapeutic agents, professional outcomes, teaching and learning methods and assessment methods

Summary maps for the curriculum will be shared during our summer Brown Bag Discussion Series. In addition, the summary maps have been forwarded to the Curriculum Revision Task Force, which will be completing a Gap Analysis using this information over the summer.

May 6, 2009

Class of 2010 Portfolio Use

Following the direction of the faculty from the February 2009 College Assembly (CA) meeting, the Portfolio Initiative for the Class of 2010 has officially been launched. Students have received access to an online orientation module that further explains the purpose and process for using portfolio during their APPE year.

Prior to their first rotation, students will post:
-Their CV,
-A personal mission statement
-Two Strengthsfinder™ Assignments
-A Pre-APPE Learning Plan

These "artifacts" will be assessed by three Pharmacist Portfolio Evaluators, Drs. Bislew, Olson and Ruuska. In addition to sharing their portfolio with their assigned Evaluator, students will also share their portfolio with their Block 1-3 preceptors during the first week of each rotation.

After blocks 3, 6 and 9, students will update their portfolios, adding reflections and information on their APPE experiences. Portfolios will be assessed at these times and will continue to be shared with preceptors.

Preceptors have received a short online presentation describing the initiative. As discussed at the February CA meeting, student and preceptor input will be gathered throughout the process to continue to refine the portfolio process. An update on the initiative will be presented this summer as part of the summer Brown Bag Discussion series.

May 5, 2009

Summer Brown Bag Discussions Announced

Over the past two years, the college has undertaken a number of new initiatives to help better assess student learning and to evolve the curriculum. Our summer Brown Bag Discussion Series will be dedicated to sharing updates on these new initiatives. Student performance data, evaluative data and interpretations will be presented. Those present at the sessions will be asked to help further interpret the data and provide input on next steps. Please plan to attend any or all of the following sessions!

Student Performance on OSCE
Mike Brown
Monday, June 8, 11:30-12:30
160 LSci/7-193 WDH

Curriculum Mapping and Gap Analysis: An 30,000 foot overview of our coverage of professional outcomes, general ability outcomes, therapeutic agents and scientific disciplines.
Kristin Janke and Charles Taylor
Monday, June 15, 11:30-12:30
302 Heller Hall/7-135 WDH

The Effect of Student Employment and Extra-Curricular Patient Care Volunteerism: How do non-required experiences assist with achievement of curricular outcomes?
Kristin Janke and Alison Knutson (PDIV)
Thursday, June 225, 11:30-12:30
160 LSci/7-135 WDH

Development of a Student Professionalism Code for the College of Pharmacy
Mike Schroeder (PDIV and Honor Council Representative)
Tuesday, July 7, 11:30-12:30
160 LSci/7-193 WDH

Students' Pre-APPE Community and Institutional Competency: What do the exam data tell us?
Kristin Janke and Chris Jolowsky
Thursday, July 16, 11:30-12:30
160 LSci/7-193 WDH

Prevalence of Pharmacy Students' Strengths as Assessed by Gallup's Strengthsfinder™: Implications for a new curriculum.
Todd Sorensen and Andy Traynor
Thursday, July 30, 12-1
160 LSci/7-135 WDH

Student Performance on the PCOA: How does U of M compare to national peers on 34 disciplines and sub-disciplines of pharmacy?
Jeannine Conway and Kristin Janke
Monday, August 3, 12-1
160 LSci/7-135 WDH

Teaching and Learning the Process of Continuing Professional Development: What have we learned from the Class of 2010's use of portfolio?
Kristin Janke
Tuesday, Aug 11, 11:30-12:30
160 LSci/7-135 WDH

May 4, 2009

Experiential Consultants

The College has invited nationally recognized experiential experts (Cynthia Boyle, University of Maryland, Christopher Turner, University of Colorado, and Craig Cox, Texas Tech University) to visit the College of Pharmacy to offer advice regarding ongoing experiential initiatives. Having these experts visit will provide an opportunity to share ideas and gain feedback as the College explores next steps in designing a new curriculum and preparing for accreditation.

Our consultant's review will include examination of policies, procedures, and the regional model. In addition, the visit will also include site visits and interviews with preceptors, experiential associates, alumni, students, staff, and faculty. Following their visit on May 6-7, the consultants will submit a report with recommendations. Thanks in advance to everyone that has agreed to meet with the Consultants during their visit.

May 1, 2009

Pre-APPE Written Exam

Also on April 29th, students completed a 30 minute written exam that was designed to complement the OSCE exam. The written exam assessed those pre-APPE competencies that did not require a real-time simulated encounter with a patient. The exam allowed the college to:

Gain experience with written assessments of practical skills
2. Develop a Pre-APPE assessment of student abilities and receive baseline measures (Pre-IPPE program) of experience gained from employment, internship and extra-curricular activities
3. Receive input on students' competency relative to the IPPE outcomes to assist with:
interpreting self reported data (see previous entry) on confidence with the IPPE competencies
b. further refining IPPE activities

The development, implementation and evaluation of this exam was truly a collaborative effort. Thanks to the following individuals for their support:

  • Exam Blueprinting-Dr. Janke
  • Exam Development-Ms. Jolowsky (IPPE Coordinator) and PDIV Student Pharmacist Colleen Flaherty (Class of 2009 and Instructor, Rasmussen College Pharmacy Technician Program)
  • Assessment and Exam Piloting-PDIV Student Pharmacists Arora, Bringe, Capouch, Lien, A. Nguyen
  • Exam Review-Drs. Taylor, Brown, Schullo-Feulner and Kundell
  • Exam Participation-All PDIII (Class of 2010) students!
  • Exam Administration-Ms. Jolowsky and Ms. Muller
  • Standard Setting-Dr. Conway, Dr. Schullo-Feulner and Ms. Jolowsky
  • Exam Analysis-Dr. Janke

Students will receive feedback on their performance, including total exam, as well as community and institutional performance. Student performance data will be shared with faculty during our summer Brown Bag Discussions series.

Pre-APPE Student Self Assessment Survey

Prior to the OSCE Assessment, the Class of 2010 was asked to complete an online Pre-APPE Self Assessment. This assessment included student self report of:

  • Patient Care Oriented Extra-Curricular Experiences
  • Patient Care Oriented Elective Experiences
  • Technician Experience
  • Institutional Pharmacy Experience (e.g. hours, functions)
  • Institutional Pharmacy Competency
  • Community Pharmacy Experience (e.g. hours, functions)
  • Community Pharmacy Competency
  • Professionalism

This assessment allowed the college to:
1) better quantify student work experiences and their effects on competency development
2) gain experience with student self reporting/self assessment.

In addition, this data complements other self report initiatives (e.g. Public Health Student Survey) to provide a more well rounded perspective on student confidence. 157 of 158 students participated. Data from this initiative will be shared with the faculty during our summer Brown Bag Discussion Series.