Poster Sessions: 13A–13AC
13A – Assessing a Longitudinal Educational Experience for Continuous Quality Improvement
We’ll explore the use of assessment tools to promote adaptability and continuous quality improvement (CQI) in a large educational program. The Scholarly Concentrations Program is a statewide, multi-level program complementing the core medical school curriculum and empowering students to delve into topics of personal interest. The pilot was launched with a “CQI” mindset; and after three years, a robust assessment plan is gathering feedback. While “building the plane as we fly it,” enrollment in the program has tripled in three years. This program example shows the ability to replicate CQI with other large educational programs anywhere.
Deb Birnbaum, Anthony Masseria, and Sarah Walsh, Indiana University School of Medicine
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Assessment Methods
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 1
13B – Assessing Critical Organizational Capacities in the Development of Online Learning Tools
Professional education and credentialing continue to move online. Creating online tools for student learning is a complex organizational activity. To better understand how organizational capacities contribute to this process, we applied a systems perspective. We qualitatively assessed the capacities of a university research center with over 20 years of online professional development experience. We evaluated these capacities using evidence-based, salient themes related to organizational learning and effectiveness: systems connections, knowledge management, inquiry, adaptability, and culture. We share assessment results to highlight how insights into capacities and organizational learning can advance the creation of online learning tools for students.
Ryan A. Wilke and Andrew Dennard, Florida State University - Florida Center for Interactive Media
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Assessment in Online Courses and Programs
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 2
13C – Assessment for Mere Mortals: The Viking Expedition for Continuous Improvement
In 2018, Carl Albert State College's Assessment Team set out to start a campus wide "assessment revolution." In order to advance assessment efforts and align with accreditation expectations, the team of five continuous improvement evangelists were tasked with a four-year HLC Assessment Academy project that focused upon maturing from the course to academic program level while assessing general education and implementing co-curricular and non-academic assessments. The "Viking Exploration Map" and session provide an overview of best practices and lessons learned along the journey. The premise is to share actionable insight with fellow colleagues to assist with their expeditions in assessment.
Kelly Kellogg, Bill Carroll, Kim Hughes, and Brook Wiersig, Carl Albert State College
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Leadership for Assessment
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 3
13D – Assessment Made Simple Through Targeted Professional Development
The University Program Assessment Committee (UPAC) at a private liberal arts university focuses on continuous student learning improvements. UPAC facilitated a two-part Assessment Summit for faculty and staff to move the needle from a good assessment process to one marked by excellence aligned with the NILOA transparency framework. The summit aimed to better engage campus stakeholders, establish more realistic goals, write concise program learning outcomes, and increase student clarity. Participants in this session will learn to adapt strategies that lead to continuous improvement of program assessment, engage in methods designed to simplify assessment processes, and maintain more meaningful assessment practices.
Ute S. Lahaie, Mary Cook, and Seth Hepner, Walsh University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Faculty Development
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 4
13E – Becoming the Village: Assessing and Improving a Department Climate for Diversity, Equity, and Inclusion
The Technology Leadership and Communication department at IUPUI has engaged in a multi-year process of assessing the departmental culture around diversity, equity, and inclusion. Using baseline data from a previous climate survey, the department implemented initiatives to address issues and improve the climate, especially for women of color. A mid-point climate assessment was undertaken to measure progress. This poster session will discuss the assessments, initiatives, results, and future plans.
Kevin Rose, Katrenia Reed Hughes, Brandon Sorge, and Corinne Renguette, IUPUI
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Diversity, Equity, and Inclusion
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 5
13F – Building a Regional Program Assessment Peer Group: From Pandemic Support to Meaningful Collaboration
Presenters will discuss the formation, structure, and process of a multi-institutional support group of assessment professionals who work at public institutions across a state. Presenters come from diverse backgrounds in assessment and higher education, a variety of office and organizational structures, and a range of institutional types. The presenters will share what they have gained from the group. Additionally, there will be discussion on strategies participants may use to establish and operate similar support groups in their regions.
Jessica M. Turos, Bowling Green State University; Jennifer Hebert, University of Akron; Shannon Helfinstine, Kent State University; Alison Kaufman, Youngstown State University; and Marc Scott, Shawnee State University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Emerging Trends in Assessment
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 6
13G – Identity Navigation and Understanding in Demographic Surveys
This study is concerned with how undergraduate students in disciplines related to Science, Technology, Engineering, and Math (STEM) select responses when answering demographic surveys, especially in cases where they were unable to map their identity to the following categories: first-generation, disability, and racialization/person of colour identification. Three types of demographic survey responses were identified: (1) alignment, (2) misreporting, and (3) misalignment. Responses were likely to be influenced by tensions between one’s self-determined identity and identity definitions placed onto them by others. A proposed adaptation of Tourangeau et al.’s (2000) Components of Survey Response model is proposed.
Christina A. Arayata, Ontario Institute for Studies in Education, University of Toronto
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Diversity, Equity, and Inclusion
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 7
13H – Institutionalizing Systematic Assessment Reporting - Considerations for Leaders
Even organizations with the best of practices go through periods of drift and change, and sometimes key positions go vacant for longer than anticipated. This presentation will explore some considerations for “rebalancing” the internal and external institution-level assessment needs of a specialized university on the west coast. Audience members will be invited to identify common sticky spots and potential solutions, and to share best practices from their own experience. The presentation will elucidate the interplay of people, technology, policy, and process that may shape or influence the scope and depth of comprehensive institutional assessment designs.
Leslie Wasson, Samuel Merritt University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Institution-Wide Data Collection/Use
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 8
13I – Data Storytelling in Assessment: A Practical Guide to Narrative Centered Research Design, Visualizations, and Reporting
Assessment practitioners are increasingly considering how they might use data storytelling approaches to communicate data in compelling ways (one of the goals articulated in the Grand Challenges in Assessment project). This poster shares practical guidance on how to effectively use data storytelling in the dissemination of assessment findings through narrative centered research design, visualizations, and written reporting. This presentation provides an overview of the cognitive science behind effective visualizations, key questions to consider when building compelling data stories, and actionable techniques attendees can implement in their own assessment work.
Jillian Morn and Jackie Belanger, University of Washington
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Emerging Trends in Assessment
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 9
13J – Equitable Approaches to Probabilities of Success: Determining the Impact of HIPs on First-Destination Outcomes
This poster showcases how one southern institution utilized logistic regression to examine the differences in the effect of certain high-impact practices (HIPs) on the likelihood of student success between white and non-white students. We discuss the basics of logistic regression and its advantages in analyzing dichotomous outcomes such as student success (i.e., successfully placed or not successfully placed). The findings indicate that internships and undergraduate research positively impact student chances of securing employment and graduate enrollment. Further, the impact of HIP participation on student success is much greater for non-white than for white students.
Ana Kriletic, Katie Boyd, and Kendall M. McGoey, Auburn University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Diversity, Equity, and Inclusion
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 10
13K – Herding Camels: Coordinating Program Assessment Across Locations and Modalities
Campbell University (home of the Fighting Camels) offers degree programs at four off-campus instructional sites and 100% online. Many programs use course-embedded assessments as measures of program effectiveness. The data produced by these assessments is informative only when the assessments have been administered, scored, and reported in the same way. In this session, you will learn how key assessment guides are used to promote fidelity of implementation among instructors. Find out how these guides make herding camels a bit easier!
Ellen E. Dobson, Campbell University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Assessment Methods
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 11
13L – Impact of Weeks of Welcome on Student Sense of Belonging and Retention
This project explores the relationship between student engagement and experience through Weeks of Welcome programs, their sense of belonging at the end of the initial transition stage to college, and the first-year success. The results will help us understand potential connections between students' engagement in Weeks of Welcome during their transitioning phase upon entering and the first-year success, measured by academic performance (GPA) and progress (retention). Specifically, whether students' level of engagement and perceived benefits matter in developing a stronger sense of belonging to the university and ultimately affect their success through the first year.
Yiyun Jie, Virginia Commonwealth University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Student Affairs and Co-Curricular Programs and Services
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 12
13M – Intentionality and Assessment in Succession Planning in Health Sciences Education
Succession planning for academic administrators requires careful planning and intentionality. In this session, attendees will review the leadership pipeline application developed by Charan and colleagues and the 360-box grid on performance and potential first reported by Noe. While understanding the need for succession planning is cognitively sound, organizations may value a step-wise methodology for hiring, identifying, nurturing, and promoting talent. Herein, the discussion will emphasize transitions and development for academic deans and the role of assessment in the process of documenting and communicating performance metrics.
Dave Weldon, William Carey University School of Pharmacy; and David Fuentes, University of Portland School of Nursing
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: General Education
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 13
13N – Learning Artifacts as Qualitative Evidence: Studying Learners’ Action Plans in an Online Course for Faculty About Inclusive Teaching
How can we use learning artifacts to better understand how an intervention influences learners? This presentation will describe the analysis of action plans that were submitted during an online course about inclusive teaching designed for faculty. We will describe the course context and design of the action plan assignment, and the qualitative analysis where we used emergent coding to identify themes in learners’ action plans. We will share our findings and clarify what they suggest about how the course influenced learners. Participants will practice coding, consider their own professional contexts, and reflect on the value of learning artifacts as evidence.
Melina Ivanchikova and Mathew Ouellett, Cornell University; and Amy Cardace, Fairleigh Dickinson University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Assessment in Online Courses and Programs
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 14
13O – Line Up! Exploring Alignment Between Institutional and Programmatic Learning Outcomes with a Diversity, Equity, & Improvement Lens
In 2020, Oregon Health and Science University (OHSU) approved new institutional graduation core competencies which infuse anti-racism and equity into the definition of each competency. This poster presents the process by which we analyzed the alignment of our programs with each of these seven core competencies and the findings of our analysis, which highlight the nuances of assessing this type of alignment. We will share data visualizations and reflections on the value of looking closely at this aspect of institutional assessment data (Hutchings, 2016). Attendees will reflect on the power of using institutional learning outcomes to promote greater equity and inclusion in our curricula.
Sarah Jacobs and Kirstin Moreno, Oregon Health & Science University
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Institution-Wide Data Collection/Use
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 15
13P – Measuring Equity in Student Career Outcomes: Findings from the National Alumni Career Mobility Survey
The National Alumni Career Mobility (NACM) Survey was developed to help institutions strategically adapt career practices and equitably guide students toward fulfilling careers. The presenters will review the NACM Survey findings of 12,000+ alumni from 220+ institutions, specifically focusing on how the data reveals equity gaps in students’ campus experiences and their connection with career outcome inequalities 5/10 years after graduation. We will then discuss how campuses can use this data to take actionable steps to narrow equity gaps.
Kimberly Yousey-Elsener and Jeremy Podany, The Career Leadership Collective
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Diversity, Equity, and Inclusion
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 16
13Q – Navigating the New Normal in Assessment with Data Visualization
This session describes how a professional program utilized assessment technology and data visualization tools to overcome common challenges such as faculty engagement, transparency, and data availability. Two key metrics are used to illustrate the process of collecting data and transforming them into meaningful visualizations, followed by a discussion of how those end products have been instrumental in promoting a culture of assessment in the program. Steps and actions needed to enact similar transformations in other programs are presented at the conclusion.
Benjamin Shultz and Rosalyn Vellurattil, University of Illinois Chicago
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Use of Technologies in Assessment
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 17
13R – Opportunities and Challenges of Technology Integration: A Case Study of One Teacher Education Program
Technology has completely redefined our expectations of the learning experience, especially related to how the teaching and learning experience must fundamentally be forward-thinking for our future educators. However, the infusion of technology remains a formidable challenge in teacher education programs. In this presentation, presenters will share the journey their education preparation program has traveled in the last decade. This journey consists of a multitude of models, approaches, and professional learning to engender a coherent framework for technology integration. Affordances and constraints of each model will be shared, in addition to their current reality and future directions.
Gaoming Zhang and John Somers, University of Indianapolis
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Use of Technologies in Assessment
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 18
13S – Pedagogical Advice in Assessment Processes in Higher Education
This experience presents exploratory results on the aspects that involve pedagogical advice in assessment processes, considering the profile of the pedagogical advisor as the agent responsible for promoting reflective teaching and decision-making that in turn promote changes in the teacher’s classroom practice for improvement of the students' learning processes.
Participants will have the opportunity to recognize the principles that allow the development of a pedagogical follow-up, taking into account the characteristics of the role of the pedagogical advisor as a co-thinker, collaborator and critical friend. To do this, the dynamics of the session will be supported by activities that promote reflection through the use of surveys and analyses of case studies.
Katina I. Camargo and Fadia Khouri, Universidad del Norte
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Faculty Development
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 19
13T – Qualitative Analysis of NSSE Text-Based Feedback to Deduce Emotion
Research over several decades has identified 7 basic emotions: surprise, joy, anger, contempt, sadness, disgust, anger, and fear. In this research, we carried out a qualitative analysis of text-based feedback provided by student responses to the National Survey of Student Engagement (NSSE) using machine learning. This presentation will show how we used the spaCy--an NLP library--to train a model to identify the emotions in the feedback from the survey and will describe the steps taken to develop the model by extracting the key features, encoding the words, and loading the model to make predictions.
Allie Michael and Abdullah Akinde, Austin Peay State University
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Institution-Wide Data Collection/Use
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 20
13U – Realizing and Addressing Graduate Student Mental Wellness: The Precursor to Learning Professional Skills
As the mental health of students gains awareness, the skillset of faculty in realizing and addressing mental wellness (both preventatively and responsively) is still developing. This presentation will share practical tools for faculty who engage with students who may be experiencing mental health issues. Presenters are psychologists who will share how simple adjustments to syllabi, language, and classroom policies may have significant positive impact on the mental wellness of students. Time for questions or discussion will be provided.
Beth A. Trammell, Alyssa Brown, and Deborah Miller, Indiana University East
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Assessment Methods
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 21
13V – Shifting the Institutional Culture of Assessment: From a Siloed Activity to a Collaborative Endeavor
In many institutions, assessment is associated with accreditation and viewed as a “top-down” process. Faculty care about students’ learning and meaningful teaching, but they may perceive assessment as a task to satisfy administrative demands or to comply with accreditation; additionally, faculty may not be involved in assessment processes at the institutional level. At Community College of Philadelphia, stakeholders worked to shift the culture of assessment from a siloed activity to one where faculty and administrators worked together. In this session, the presenters will demonstrate the steps and strategies undertaken that resulted in a positive shift in the culture of assessment.
Girija Nagaswami, Sesime Adanu, Amy Birge-Caracappa, Elizabeth Canapary, Elizabeth J. Gordon, Ilze Nix, Stephanie Scordia, and Eric Shannon, Community College of Philadelphia
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Faculty Development
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 22
13W – Successful Transitions – Using Human, Political, and Structural Resources to Ensure a Smooth Logistical and Cultural Transition to a New Assessment Director
Often, change can cause chaos to campus-wide assessment initiatives, but using existing resources from faculty, staff, and other stakeholders along with clear communication strategies and training can ensure when a new director is hired that previous hard work and progress doesn’t halt. This session will present organizational and strategic communication strategies with real-life examples of ushering in a new era with a new Director of Assessment.
Ashley A. Vasquez and Sheri Barrett, Johnson County Community College
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Community Colleges
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 23
13X – Using an Open-Systems Approach to Achieve and Assess Programmatic Outcomes in HBCU/PBI Pharmacy Programs
With pandemic and admissions pressures, new approaches are needed to ensure programmatic outcomes, including board examination success, faculty development, alumni engagement, and mission fulfillment. A series of collaborative pilots were implemented between six Historically and Primarily Black Doctor of Pharmacy Programs to address shared needs for professional development, prepare students for standardized examinations, and support recent graduates as they prepare for licensure. An open-systems model of information and resource sharing was developed to address stakeholder needs. This session will describe these efforts and outline open-systems approaches to incorporate strategic partners in defining problems and posing actionable solutions.
Jeremy Hughes, Chicago State University; Tonya Martin and Jocelyn Spates, Florida A&M University College of Pharmacy and Pharmaceutical Sciences, Institute of Public Health; Aisha Morris Moultry, Texas Southern University College of Pharmacy and Health Sciences; and Mohd Shahid, Chicago State University College of Pharmacy
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Graduate/Professional Education
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 24
13Y – Using the CAOOL (A Variation of COOL, Nino 2012) to Write Strong, Clear, and Concise Outcome Statements
The purpose of the presentation is to introduce attendees to the CAOOL method to write strong outcome statements. Unlike the SMART principle and the ABCD method, CAOOL offers a unique approach to outcomes in that CAOOL specifically indicates what element should be included in the statement and the position of the element within the statement. CAOOL can be used to draft all kinds of outcome statements from general to specific and from administrative to co-curricular. As a variation to the COOL Syntax (Nino, 2012), CAOOL expands clearly on all the required elements of an outcome statement.
Pedro Nino, North Carolina Central University
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Assessment Methods
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 25
13Z – What Do We Need in Our Toolkit? The Professional Development Needs of Higher Education Assessment Professionals
What skills do assessment professionals (APs) need to be successful in higher education? APs come from eclectic academic backgrounds, often with no prior training in assessment. However, with the increased importance of assessment in higher education, APs also manage additional responsibilities and roles. To meet these demands, training and professional development opportunities are essential for APs. Join the presenters as they illustrate the findings of their national survey on APs’ academic backgrounds, training sought, and professional development needed to be successful. Attendees can utilize the information to drive the creation of future AP professional development and academic curriculum.
Nikki Christen, The University of Tennessee, Knoxville/Tennessee Technological University; and Jennifer A. Morrow, The University of Tennessee, Knoxville
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Graduate/Professional Education
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 26
13AA – What We Have Learned from Hexic HD: Leveraging Principles of Gamification to Increase Learner Engagement Using Your Gradebook
This session explores the use of gradebook design for a graduate online course, “Healthcare in the US,” offered at Purdue University’s College of Health and Human Sciences (HHS). While working with the faculty, it was mutually agreed that sound course design involved both formative and summative assessments using a balanced gradebook. The point-based gradebook was inspired by principles of gamification and self-regulation, like Microsoft’s Xbox Achievements feature that awards users when they reach certain criteria while playing a game. In this session, we will discuss how to leverage gamification to increase student engagement with gradebook design.
Allan Celik, Purdue University
Presentation Type: Poster Session
Audience Level: Beginner
Primary Track: Assessment in Online Courses and Programs
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 27
13AB – What Makes an Assessment Professional Proficient? Examining and Updating Proficiencies for Assessment Librarians and Coordinators Through the Lens of Social Justice, Equity, Diversity, and Inclusion
Higher education is calling for increased accountability in an evolving climate in which social justice, equity, diversity, and inclusion (SJEDI) must be a cornerstone of our work. Campus administrators have responded by assigning assessment duties or creating positions to assess value and create a culture of assessment. But what defines an assessment professional? What proficiencies do they need to succeed? Join session presenters who are leading efforts to update the Proficiencies for Assessment Librarians and Coordinators to ensure SJEDI is centralized in our practice, outline proficiencies that should be included, and consider sources when updating standards.
Becky Croxton, University of North Carolina at Charlotte; Megan Oakleaf, Syracuse University; Je Salvador, University of Washington Bothell & Cascadia College Campus; and Jung Mi Scoulas, University of Illinois Chicago
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Diversity, Equity, and Inclusion
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 28
13AC – Who Has Time for Stress? Exploring Student Stress and Its Relationship to Student Time Use
Research suggests that health professions students experience significant stress and are at risk for major depression. However, little is known about the relationship between student time use and stress. It is imperative to recognize the implications of time as a finite resource and the time expectations health professions education has for students. This session will summarize current research on the topics, engage participants in active discussion, and outline actionable strategies that can be used to support student wellbeing and minimize unnecessary stress triggers.
Jacqueline M. Zeeman, UNC Eshelman School of Pharmacy
Presentation Type: Poster Session
Audience Level: Intermediate
Primary Track: Graduate/Professional Education
Time: 5:30–6:45 p.m.
Room: Marriott 5 & 6
Poster Board: 29