1 / 15

GenAI in Assessment

A Practical Guidebook for Massachusetts Public Higher Education
An Overview for the AMCOA State Meeting

Note: This presentation provides an overview of the guidebook, not a workshop on its content.

Presenters

Dr. Ruth Slotnick
Director of Assessment, Bridgewater State University

Dr. Robert Awkward
Assistant Commissioner for Academic Effectiveness
MA Department of Higher Education

Event Details: September 19, 2025 | 10:00 AM – 12:00 PM
"Assessment professionals cannot afford to wait for institutional permission or perfect preparation."

Impetus & Timeline

Why This Guidebook, Why Now?

The Critical Challenge

7%
Feel "Very Prepared" for GenAI
55%
"Somewhat Prepared"
38%
"Not Prepared" at All

(Source: Slotnick & Nicholas, 2024, p. 12)

Project Timeline

January 2025
DHE launches initiative - Charge defined
March 2025
Drafting begins with working group
April 2025
Campus consultation across sectors
May 2025
Revision based on feedback
June 2025
Final wrap & handoff to DHE

About the Guidebook

A "For Us, By Us" Resource

Purpose & Design

Collaborative Creation

Designed collaboratively by practitioners across:

  • Community Colleges
  • State Universities
  • UMass Campuses
  • Specialized Institutions (MassArt, Mass Maritime)

Five Core Principles

  1. GenAI as Enhancement, Not Replacement: AI supports rather than supplants human expertise
  2. Transparency & Continuous Improvement: Document use and systematically review
  3. Equity at the Core: Center justice and inclusion in all applications
  4. Contextual Relevance: Adapt to institutional mission and student needs
  5. Professional Growth: Commit to ongoing learning and development

How to Use This Resource

  • Explore sequentially or by chapter based on need
  • Use self-assessment tools in Appendix A
  • Follow decision trees in Appendix D
  • Implement quick-start action plans from Appendix E

Working Group Members

Cross-Institutional Collaboration

Leadership Team

Ruth Slotnick (Lead)

Director of Assessment
Bridgewater State University

Peter Shea (Co-Lead)

Assistant Dean of AI Integration
Middlesex Community College

Gaelan Lee Benway

Dean for Curriculum, Instruction, Assessment & Professional Development
Quinsigamond Community College

Joanna Boeing

Assistant Director of Assessment
Bridgewater State University

Junelyn Pangan Peeples

Assistant VP for Institutional Research & Strategic Effectiveness
MassArt

Gabriel Rodriguez

Senior Assessment Analyst
UMass Amherst

Commissioners

Dr. Richard Riccardi - Deputy Commissioner for Academic Affairs & Student Success

Dr. Robert Awkward - Assistant Commissioner for Academic Effectiveness

Dedication

Honoring our Assessment Champion!

Dr. Peggy Maki

"Dedicated to Dr. Peggy Maki, whose pioneering partnership with Massachusetts' AMCOA initiative redefined institutional capacity for equity-driven assessment."

Her Legacy

  • Architect of the Commonwealth's 2011-2013 Davis Foundation-funded initiative
  • Equipped all 28 undergraduate-serving public institutions with VALUE rubric-driven analysis
  • Transformed AMCOA into a national model for cross-institutional collaboration
  • Embedded real-time analysis of enrolled students' evolving needs into Massachusetts' academic DNA
  • Demonstrated how statewide systems could leverage assessment as both diagnostic tool and moral imperative
"Her legacy endures in every campus that treats assessment as a covenant with current learners, ensuring today's data fuels today's equity interventions."

Chapter 1: The Assessment Professional in the Era of GenAI

Understanding Our Current State

The Readiness Gap

69%
NOT Currently Using GenAI
31%
Currently Using GenAI
50%
Expect Moderate to Major Future Role

(Source: Slotnick & Nicholas, 2024, p. 12)

Six Professional Roles (Jankowski & Slotnick, 2015)

  1. Method Expert: Technical assessment expertise
  2. Translator: Bridge between stakeholders
  3. Facilitator: Enable collaborative processes
  4. Political Navigator: Navigate institutional dynamics
  5. Visionary: Imagine future possibilities
  6. Social Justice Advocate: Center equity in all work

Spheres of Influence (Covey Framework)

Control

Personal productivity tools, data analysis, report generation

Influence

Faculty partnerships, committee work, collaborative projects

Concern

Institutional policy, budget allocations, sector initiatives

Chapter 2: Technical Foundations

Understanding How GenAI Works

Five Core Principles

  1. Enhancement, Not Replacement - AI supports human expertise
  2. Transparency & Continuous Improvement - Document and review using 8KQ
  3. Equity at the Core - Enhance opportunities for all
  4. Contextual Relevance - Focus on institutional mission
  5. Professional Growth - Commit to ongoing learning

⚠️ Understanding LLMs

  • Learn through pattern recognition, not comprehension
  • Trained on texts that may contain biases
  • Require human validation

Bias & Validity Concerns

Chapter 3: Implementation Frameworks

From Concept to Practice

The Implementation Challenge

The Paradox: While 50% expect GenAI to play a major role, only 12% frequently use it for data analysis—one of the simplest applications.

Three Key Frameworks

1. Data-Lifecycle Approach

  1. Generation & Collection: Design surveys, create rubrics
  2. Processing & Cleaning: Standardize formats, identify outliers
  3. Analysis & Pattern Recognition: Thematic analysis, trend identification
  4. Interpretation & Contextualization: Apply institutional context
  5. Reporting & Communication: Tailor for diverse audiences

2. People-Process-Technology (PPT) Framework

  • People: Build human capacity first, identify champions
  • Process: Map workflows, add validation checkpoints
  • Technology: Select secure, interoperable tools

SAMR Model Progression

Substitution

AI replaces manual tasks

Augmentation

AI enhances traditional processes

Modification

AI enables task redesign

Redefinition

AI creates new possibilities

Chapter 4: Faculty Partnerships

Leading Academic Integration

The Dual Learning Challenge

Assessment professionals must develop their own GenAI competencies while simultaneously guiding faculty through parallel learning journeys.

Understanding Faculty Perspectives

71%
Teachers View GenAI as Essential
65%
Students View GenAI as Essential
82%
IR/Assessment Offices Rate GenAI Maturity as "Non-existent or Reactive"

(Source: Walton Family Foundation, 2023, p. 30 for teachers; McKinsey & Company, 2023, p. 5 for similar metrics)

Common Faculty Concerns

Capacity-Building Strategies

  • Form cross-departmental learning communities
  • Offer hands-on, discipline-specific workshops
  • Document and share early wins
  • Co-develop rubrics and assessment tools
  • Create safe spaces for experimentation

Chapter 5: Navigating Institutional Realities

Policy, Budget, Cautions & Guardrails

The Policy Vacuum

39%
Have Institutional GenAI Policies
8%
Have Divisional Policies
9%
Have Office-Specific Guidance

(Source: Slotnick et al., 2025, p. 36)

Subscription Realities

(Source: Slotnick et al., Summer 2025 Survey, calculated from Q8)

High-Impact Risk Categories

  1. Data Privacy/Security: FERPA compliance, vendor assessments
  2. Bias/Equity: Systematic bias detection protocols
  3. Accuracy/Validation: Compare GenAI vs. traditional methods

Chapter 6: The Massachusetts Advantage

Collaboration & Networks

Structural Advantages

Three Pillars of Success

  1. Institutional Diversity: Community colleges, state universities, UMass campuses, specialized institutions
  2. State Coordination: DHE leadership and strategic initiatives
  3. Collaborative Networks: AMCOA, MACH, cross-institutional partnerships

Key Initiatives

AMCOA

Assessment collaborative driving equity-centered practices

MACH

Massachusetts AI Collaborative for Higher Education

GenAI in Assessment Working Group Members

For guidance and help

Role-Based Action Steps

"No assessment professional needs to navigate GenAI transformation alone."

Looking Forward

From Pilots to Transformation

Key Transitions Ahead

Immediate Priorities

  • Move from pilots to durable, auditable workflows
  • Align program outcomes with AI literacy requirements
  • Invest in data stewardship and ethical guardrails
  • Strengthen faculty partnerships for curriculum integration

Transformative Applications on the Horizon

  1. Automated Evidence Maps: Real-time dashboards for accreditation
  2. Predictive Analytics: Early intervention for at-risk students
  3. Personalized Assessment: Adaptive learning pathways
  4. Cross-Institutional Platforms: Shared resources and benchmarking
"GenAI is accelerating change, but the mission remains: help students succeed. These collaborative structures enable systematic approaches to innovation while preserving institutional autonomy."

Long-Term Research Priorities

Next Steps & Resources

Your Action Plan

Guidebook Appendices

  • Appendix A: AI Readiness Self-Assessment
  • Appendix B: Terminology Glossary
  • Appendix C: Professional Development Resources
  • Appendix D: Implementation Decision Tree
  • Appendix E: Monday Morning Quick-Start Plan

Start Small, Think Big

Common First Tasks to Try:

  1. Thematic analysis of survey responses
  2. Initial report outlines
  3. Meeting summaries
  4. Literature reviews
  5. Rubric development
  6. Data interpretation assistance

Red Flags - When NOT to Use GenAI

Remember: Build momentum through documented efficiency gains!

Questions & Discussion

Let's Learn Together

Reflection Prompts

  1. What's one GenAI application you could pilot next week?
  2. Which framework resonates most with your institutional context?
  3. What support do you need from AMCOA or DHE?
  4. How can we share learnings across institutions?

Contact Information

Ruth Slotnick
Email: rslotnick@bridgew.edu

Robert Awkward
Massachusetts Department of Higher Education
Email: rawkward@dhe.mass.edu

"Assessment professionals can position themselves to steer GenAI toward greater institutional effectiveness and deeper student learning."

Additional Resources

Continue the Journey

Upcoming Events

Virtual Preview Session

Date: Tuesday, October 21, 2025

Time: 3:00-4:00 PM Eastern

Recent survey findings will be shared

GenAI Community of Practice

Join the Assessment Institute's GenAI Community of Practice for ongoing support, resource sharing, and collaborative learning.

Learn more: assessmentinstitute.indianapolis.iu.edu

Important Notes

"By integrating GenAI with purpose, transparency, and equity commitments, assessment professionals ensure that each decision supports student success while reflecting shared dedication to educational excellence."

Thank You!