Expanding the Value of Assessment

Sponsored by the Office of Academic Affairs

Friday, February 10, 2017
9 a.m.–2 p.m.
The Fawcett Center


Agenda

Pre-conference workshop: Assessment Basics
Friday, February 3 | 2–3:30 p.m.
150 Younkin Success Center

Conference Schedule

(Click for Fawcett Center floor plan)

8:30–9:00 a.m. Check-in and coffee Grand Ballroom
9:00–9:15 a.m. Welcome and Opening Remarks
W. Randy Smith, Vice Provost, Academic Affairs
Bruce A. McPheron, Executive Vice President and Provost
Grand Ballroom
9:20–10:20 a.m. Plenary with Peer Institutions
Featuring a conversation with colleagues from the Universities of Minnesota and Wisconsin
Grand Ballroom
10:30-11:20 a.m. Breakout Sessions Breakout Rooms
11:30-12:20p.m. Breakout Sessions Breakout Rooms
12:30-2:00 p.m. Lunch and Remarks by Vice Provost Randy Smith Grand Ballroom

Session Descriptions

Assessment Basics

Pre-conference workshop for those new to assessment
Friday, February 3 | 2–3:30 p.m.
150 Younkin Success Center

This pre-conference session will provide a basic overview on how to get started with designing and managing your department’s program assessment. It is designed for people who have just begun this role or would like a refresher. Participation will help to prepare you to get the most out of the February 10th assessment conference.


Plenary Session

Peer Institutions Share Their Assessment Experiences

Grand Ballroom

Alexis Collier will host a conversation with Jocelyn Milner (Wisconsin-Madison) and Joseph Shultz (Minnesota-Twin Cities) about their experiences with the process and value of assessment at some of our peer institutions.

Panelists

Jocelyn Milner
Vice Provost for Academic Affairs and Director of Academic Planning and Institutional Research, University of Wisconsin-Madison

Joe Schultz
Assistant Vice President in the Office of the Executive Vice President and Provost, University of Minnesota

Moderator

Alexis Collier
Former Assistant Provost and Faculty Emeritus, The Ohio State University

Concurrent Breakout Sessions

All sessions will be held twice (once in each time slot).

Assessing the Major

Franklin/Hamilton Room

Janice Aski
Professor, Department of French and Italian
Director, Italian Language Program

Recently, Ohio State began to use a nationally normed examination of language proficiency to assess the language abilities of graduating Italian majors. The results confirmed that they were reaching only “intermediate” proficiency. Professor Janice Aski will share her experiences of using this data to change the program to attempt to improve this outcome.

Discussion with Peer Institution Panelists

Highland Room

Keynote panelists Jocelyn Milner (Wisconsin-Madison) and Joe Shultz (Minnesota-Twin Cities) will expand on their experiences with assessment and answer your questions about their institutions’ assessment efforts.

The upcoming review of the OSU General Education program — the expected process, and your suggestions for how to provide input

Hancock Room

Larry Krissek
Professor and Director of Administration, School of Earth Sciences

Catherine Montalto
Associate Professor, Department of Human Sciences

In this session, Catherine Montalto (Human Sciences) and Larry Krissek (Earth Sciences) will outline the general process expected to be used in the upcoming university-wide review of the General Education program. Participants in this focus session will be encouraged to provide feedback on the expected process, with a particular goal of ensuring that the GE review benefits from broad participation across the university.

Graduate Program Assessment: How to Use Assessment Data

Monroe Room

Amy Ferketich
Professor, College of Public Health

Scott Herness
Interim Vice Provost for Graduate Studies
Interim Dean of the Graduate School

May Mergenthaler
Associate Professor and Director of Graduate Studies, Germanic Languages and Literatures

Thomas Mitchell
Associate Professor, FAES

Sarah Williams
Academic Program Specialist, Plant Pathology

Graduate program assessment allows faculty to answer two questions. First, what do we want students to know and do by the end of their graduate program at Ohio State? Second, how will we know if they achieve these goals? This workshop will focus on the second question, as graduate programs are now collecting assessment data. The presenters will incorporate examples from OSU graduate programs that have been collecting and using assessment data.

Using Carmen for Assessment

Alumni Lounge

Staff from the Office of Distance Education (ODEE) Carmen team will share some of the tools available in the Canvas LMS that can be used for learning outcomes assessment. This session will also include a preliminary look at how Ohio State might make use of Canvas data.


Lunch Program

Grand Ballroom

Vice Provost W. Randy Smith will provide a brief overview of the University’s response to its forthcoming institutional re-affirmation of accreditation with the Higher Learning Commission. It will focus on the examples the University is using to show its commitment to:

Teaching and Learning: Quality, Resources and Support and Evaluation and Improvement

This will be an important way to see how the work of individual units fits within the broader context of teaching and learning at the University.

Your feedback will be helpful.

Presenter Biographies

Keynote Panelists

Jocelyn Milner became director of Academic Planning and Institutional Research at University of Wisconsin-Madison in 2003, and was appointed to the additional role of vice provost for academic affairs in 2016. She first joined the UW-Madison Office of the Provost as an academic planner in 1999. Her primary interests in academic administration include systems that support the entire academic program array, academic policy and practice that support educational quality, data analytics to support the academic enterprise, and accreditation. Her office oversees curricular and academic planning, institutional research, and data management at UW-Madison. She serves as a peer reviewer for the Higher Learning Commission and is a past council chair for the Association of American Universities Data Exchange. She received her Ph.D. in biochemistry from the University of Guelph (Canada) and served as a post-doctoral fellow and instructor at UW-Madison in the departments of Chemistry and in Plant Pathology: in those roles she co-authored more than a dozen scientific publications and contributed to numerous research grants.

Joseph (Joe) Schultz is assistant vice president in the Office of the Executive Vice President and Provost at the University of Minnesota.  Joe has worked at the University of Minnesota since 2002 and has worked for the Provost since 2006.  Previously, he has held positions in support of research, graduate and professional education in the College of Engineering at Cornell University and student development at Indiana State University.

In his current position, Joe supports the provision of information, analysis, and coordination for executive leadership at the Twin Cities campus and across the five-campus system comprising the University of Minnesota. Joe’s responsibilities include academic program approval, academic program review, accountability reporting, and academic planning (collegiate compacts).  He is the Provost’s liaison to the University of Minnesota Board of Regents and has recently designed the University’s realignment of postbaccalaureate education into distinct graduate and professional communities.  Joe is also the University’s accreditation liaison and serves as a peer reviewer for the Higher Learning Commission.  He led the team preparing for the University’s successful comprehensive accreditation review in 2015.  This work included reassessing and redesigning assessment of student learning efforts at the undergraduate and graduate level and redesigning the University’s process for academic program review.

Joe holds a Ph.D. in educational policy and administration from the University of Minnesota. He also has an M.S. in college student personnel from Indiana State University and a B.S. in consumer science from the University of Wisconsin-Madison.


Concurrent Breakout Session Presenters

Janice M. Aski is professor and director of the Italian language program. She specializes in foreign language pedagogy and historical Italian/Romance linguistics. She is a co-author of the first-year Italian textbook, Avanti!, and the Italian historical linguistics monograph, Iconicity and analogy in language change. She has published a variety of articles in both of her fields of expertise. Her research in foreign language pedagogy explores topics, such as testing, reading and how grammar practice activities reflect the most current research in second language acquisition. Her publications in historical Italian/Romance linguistics focus on the social, pragmatic, and cognitive aspects of phonological and morphological change. She is the recipient of the Rodica C. Botoman Award for Distinguished Undergraduate Teaching and Mentoring, the Alumni Award for Distinguished Teaching, and Colleges of the Arts & Sciences Outstanding Teaching Award.

Amy Ferketich is a professor in the Division of Epidemiology in the College of Public Health. In the College, she served as Chair of the Graduate Studies Committee (2008-2012) and Chair of the Undergraduate Studies Committee (2012-2015). She has been serving as a member of the Graduate School’s Assessment Committee since its formation and is now a Faculty Fellow working on Graduate Program Assessment in the Graduate School.

Scott Herness is the Interim Dean of the Graduate School and Professor in the College of Dentistry. He has previously served as Chair of the Division of Oral Biology, Chair of the Oral Biology PhD Program, and Chair of the Neuroscience Graduate Studies Program. Prior to his arrival at the Ohio State University, he was Assistant Professor at The Rockefeller University in New York City and Associate Professor at the Indiana University School of Medicine. His research interests are in the field of sensory neuroscience.

Lawrence (Larry) Krissek is a professor and Associate Director for Administration in the School of Earth Sciences in the College of Arts and Sciences. He earned his BS from the University of Washington, and his PhD in marine geology from Oregon State University. He joined the faculty at Ohio State in 1982. He has served on the Arts & Sciences Curriculum Committee since 2003, and chaired that committee as ASC major and minor programs were converted to semesters.  He also has served on ULAC (the University-level Advisory Committee on General Education) since 2013.  He received the Ohio State University Alumni Award for Distinguished Teaching in 1998, and was recognized with a President and Provost’s Award for Distinguished Faculty Service in 2015. Larry is now a Faculty Fellow and a co-chair of the General Education Review Coordinating Committee.

May Mergenthaler is Associate Professor and Director of Graduate Studies (since AU 2015) in Germanic Languages and Literatures; her teaching and research encompass literature (especially poetry), literary theory, and philosophical aesthetics from the 18th century to the present; her special focus is the period of Romanticism.

Thomas Mitchell is an Associate Professor in the Department of Plant Pathology in the College of Food, Agricultural, and Environmental Sciences. He is the Director of the Office of Education for his professional society, CFAES Academic Affairs Committee, and Chair of the Translational Plant Sciences Graduate Studies Committee in addition to numerous editorial and scientific boards. He was the Senior Scientist and Research Associate Professor at the North Carolina State Universities’ Center for Fungal Research before joining Ohio State in 2007.

Catherine P. Montalto is an associate professor in the Department of Human Sciences in the College of Education and Human Ecology. She earned her BS from The Ohio State University and her PhD in consumer economics from Cornell University. She joined the faculty at Ohio State in 1992. She served on the Graduate School Curriculum Committee from 2008 through 2015, and is currently on the curriculum committee for the College of Education and Human Ecology. She was recognized with a President and Provost’s Award for Distinguished Faculty Service in 2015. Catherine is now a Faculty Fellow and a co-chair of the General Education Review Coordinating Committee.

Sarah Williams is an Academic Program Specialist in the Department of Plant Pathology, College of Food, Agricultural, and Environmental Sciences. She teaches introductory plant pathology courses and supports other aspects of the Department’s academic programs, including developing and implementing assessment plans and tools to measure learning.


“Using Carmen for Assessment” Panelists

Valerie Rake is Associate Director for eLearning Support in the Office of Distance Education and eLearning.  She manages the team that provides support and training for Carmen and rest of ODEE’s online toolset.  For the past 18 months, she has been co-project manager for the Canvas evaluation and adoption projects.

Jeff Vernon is the Strategic Initiatives Manager for the Learning Systems and Infrastructure (LSI) team with the Office of Distance Education and eLearning. He evaluates new solutions and trends in learning technology, as well as manages the project portfolio for ODEE’s LSI team. Over the past 18 months, he has co-managed the Canvas evaluation and adoption projects at Ohio State.

Vedu Hariths is Associate Director for Development in the Office of Distance Education and eLearning.  He manages the team that develops software to support the ODEE’s online toolset and other strategic applications. Among his upcoming projects will be a reporting framework that combines Canvas data with data from other reporting systems.

Ken Matthias is an Instructional Designer with the Office of Distance Education and eLearning. He works with faculty across the university whose departments have partnered with ODEE to develop online degrees and certificates. He is currently working in Canvas with learning outcomes, rubrics, and the Learning Mastery Gradebook, investigating program-level reporting of outcomes mastery.

Amy Jauch is a Clinical Instructor of Practice and Lead Faculty for the RN to BSN program with the College of Nursing.  She earned her MSN in nursing education from Indiana Wesleyan University and has been working in academic nursing education since 2007.  She recently was awarded an Affordable Learning Exchange grant to decrease the number the number of textbooks used in the RN to BSN program. She also is working with the Office of Distance Education and eLearning the College of Nursing IT department to utilize features in Canvas (rubrics, outcomes, and Learning Mastery gradebook) to obtain data for accreditation and reporting.

Byron Roush is the Director of Educational Technology at The Ohio State University College of Social Work. He supports faculty in their use of educational technology, supports curricular assessment processes utilizing CarmenCanvas and coordinates the college’s instructional design team (responsible for the development of online courses, programs and continuing education). He currently serves as a member of the Learning Management System steering committee and was a member of the Learning Management System evaluation committee.

Denise Bronson is an Associate Professor at The Ohio State University College of Social Work and served as the college’s Associate Dean for Academic Affairs from 2009-2016. Her scholarship has promoted the use of evidence-based practices in child welfare and completed a systematic review on family reunification services; additionally, she currently teaches courses on practice evaluation.

Resources

Graduate Program Assessment: How to Use Assessment Data

Slides

Handout

Using Carmen for Assessment

Slides