Assessing Learning Outcomes for Generative AI in Higher Ed

Assessing Learning Outcomes for Generative AI in Higher Ed

The Emergence of Generative AI in Higher Education

The last year has seen a surge in the capabilities of generative artificial intelligence (GAI) tools, with the introduction of technologies like ChatGPT, Bard, and DALL-E. These advancements have captured the attention of educators and administrators across higher education, as they grapple with both the exciting potential and concerning risks that these new AI tools present.

GAI models, particularly large language models (LLMs) like ChatGPT, have the ability to generate human-like text, code, and even images in response to user prompts. This raises significant questions about how these technologies will impact teaching, learning, and assessment in colleges and universities. On one hand, GAI could help customize the learning experience for individual students, increase accessibility, and assist instructors in tasks like grading and content creation. On the other hand, there are valid concerns about academic integrity, biased or inaccurate outputs, and the risk of students relying on GAI to circumvent the learning process.

As GAI becomes more ubiquitous, educators must re-examine the learning objectives and outcomes for their courses, and develop policies and strategies to harness the benefits of these tools while mitigating the risks. This article will explore the key considerations and provide a framework for how higher education institutions like Stanley Park High School can approach the integration of GAI in a way that supports student learning and academic integrity.

Opportunities and Concerns with GAI in Higher Education

The emergence of GAI in higher education presents both exciting opportunities and significant concerns that must be carefully navigated. Let’s examine some of the key considerations:

Opportunities:

Personalized Learning Experiences: GAI has the potential to provide students with customized learning experiences, adapting content and support to individual needs and learning styles. This could improve accessibility and engagement for a diverse student population.

Scalable Feedback and Iteration: GAI tools can generate personalized feedback on student work, allowing for more frequent and timely feedback to support iterative learning. This could free up instructor time to focus on high-level guidance and support.

Enhanced Productivity and Creativity: GAI can assist students in tasks like research, ideation, and content creation, potentially enabling them to be more productive and creative in their work.

Concerns:

Academic Integrity Violations: The ease with which GAI can generate human-like text, code, and other deliverables raises significant concerns about students using these tools to circumvent learning and submit work that is not their own.

Biased or Inaccurate Outputs: GAI models can perpetuate biases and generate inaccurate information, which could lead to students learning or relying on flawed content.

Overreliance and Skill Atrophy: If students become overly dependent on GAI tools, they may fail to develop essential skills and critical thinking abilities that are crucial for their academic and professional success.

Accessibility and Equity Concerns: Unequal access to GAI tools could exacerbate existing disparities, with some students having an unfair advantage over others.

To address these opportunities and concerns, educators must carefully consider how to integrate GAI into their teaching practices and assessment strategies, while ensuring that learning outcomes remain the primary focus.

A Flexible Framework for GAI Integration

Given the diverse nature of higher education, a one-size-fits-all approach to GAI integration is unlikely to be effective. Instead, we recommend a flexible framework that allows instructors to choose the appropriate level of GAI use based on the specific learning objectives and assessment methods for their courses.

Prohibited Use

In some cases, the use of GAI may be entirely prohibited, particularly when the learning objectives are focused on the development of fundamental skills or knowledge that should not be circumvented. Examples may include:

  • Introductory courses where the goal is to build a strong foundation of knowledge and skills
  • Assignments or assessments designed to evaluate basic competencies or understanding
  • Courses or activities where academic integrity is of the utmost importance, such as those involving sensitive or confidential information

In these situations, instructors should clearly communicate to students that the use of GAI tools is not allowed, and implement appropriate measures to detect and address any violations.

Allowed with Attribution

For certain learning activities or assignments, the use of GAI may be allowed, but with the requirement that students properly attribute the source of any GAI-generated content. This approach acknowledges the potential value of GAI in enhancing student productivity and creativity, while also reinforcing the importance of academic integrity and the development of critical thinking skills. Examples may include:

  • Research and literature reviews, where GAI can assist in gathering and summarizing information
  • Creative writing or ideation exercises, where GAI can help students generate initial ideas or content
  • Coding or programming assignments, where GAI can provide assistance with specific tasks

In these cases, instructors should provide clear guidelines on how students should acknowledge the use of GAI and ensure that any GAI-generated content does not constitute the entirety of the student’s work.

Encouraged Use

In some instances, the use of GAI may be actively encouraged, particularly when it can enhance accessibility, personalization, or higher-order learning outcomes. Examples may include:

  • Accommodations for students with disabilities, where GAI can help address barriers to learning
  • Assignments or activities focused on evaluating, critiquing, or applying GAI outputs
  • Collaborative projects where students work together to leverage GAI in their creative or problem-solving processes

In these scenarios, instructors should provide guidance on effective and responsible use of GAI, as well as opportunities for students to reflect on the limitations and ethical considerations of these tools.

Implementing the GAI Framework

Regardless of the approach chosen, clear communication and transparency are essential. Instructors should clearly articulate their policies on GAI use in their course syllabi and assignment instructions, and discuss these policies with students at the beginning of the term. Additionally, the university should provide resources and support to help faculty members navigate the integration of GAI in their teaching practices.

Communicating Policies and Expectations

When developing and communicating GAI policies, instructors should consider the following:

  • Clearly define what constitutes acceptable and unacceptable use of GAI tools
  • Provide examples of how GAI can be used responsibly (e.g., for research, ideation, or productivity) and how it should not be used (e.g., for generating complete assignments or circumventing learning objectives)
  • Explain the rationale behind the chosen policies, emphasizing the importance of academic integrity, skill development, and equitable access to learning opportunities
  • Outline the consequences of violating the GAI policies, such as grade penalties or academic integrity violations

By setting clear expectations and providing a thorough explanation of the policies, instructors can help students understand the importance of responsible GAI use and engage them as active partners in maintaining academic integrity.

Institutional Support and Resources

To support faculty in the effective integration of GAI, the university should:

  • Develop comprehensive guidelines and best practices for GAI use in higher education, drawing on input from faculty across disciplines
  • Provide training and workshops to help instructors understand the capabilities and limitations of GAI tools, as well as strategies for incorporating them into their teaching
  • Invest in technology solutions and tools that can assist in detecting and addressing GAI-related academic integrity issues, while ensuring these tools are used ethically and equitably
  • Explore opportunities for collaboration with GAI providers to ensure that the university’s educational needs and concerns are addressed in the development of these technologies

By taking a proactive and collaborative approach, the university can empower faculty to leverage the benefits of GAI while mitigating the risks, and prepare students for the responsible use of these tools in their future academic and professional endeavors.

Conclusion

The emergence of generative artificial intelligence in higher education presents both exciting opportunities and significant challenges. As these technologies continue to advance, it is crucial that educators and institutions take a thoughtful and strategic approach to their integration, focusing on preserving academic integrity, supporting diverse learning needs, and preparing students for the responsible use of GAI in their future careers.

By adopting a flexible framework that allows for prohibited, allowed with attribution, and encouraged use of GAI, Stanley Park High School can ensure that the integration of these tools aligns with specific learning objectives and assessment methods across a wide range of disciplines. Through clear communication, comprehensive institutional support, and a commitment to ethical and equitable practices, the school can harness the benefits of GAI while mitigating the risks, and empower students to navigate the evolving landscape of technology in higher education and beyond.

As the field of generative AI continues to rapidly evolve, it is essential that educators and institutions remain vigilant, adaptable, and proactive in their approach. By doing so, they can ensure that the integration of these transformative technologies enhances the quality of education, strengthens academic integrity, and prepares students for success in an increasingly AI-driven world.

Scroll to Top