ChatGPT in the Classroom: Promising Performance, Moderate Perceptions, and a Need for Caution

Summary of Key Points

• 📊 The Study: A meta-analysis of 51 experimental studies on ChatGPT's impact in education, published between late 2022 and early 2025.
• 📈 Learning Performance: The analysis found a large positive effect (Hedges’s g = 0.867) of ChatGPT on student learning performance. This effect was strongest in skills-based courses, in problem-based learning models, and when used for a duration of 4–8 weeks. [1][2] (Hedges' g is a statistical measure used to quantify the effect size, specifically the standardized mean difference between two groups.)
• 🤔 Learning Perception & Higher-Order Thinking: The study reported moderately positive effects on both students' perception of learning (g = 0.456) and their development of higher-order thinking (g = 0.457). [1][2]
• 🔬 Important Caveats: The authors explicitly state that the sample sizes for the perception and higher-order thinking analyses were small (19 and 9 studies, respectively), which calls for a cautious interpretation of these specific findings. [2]
• 🧑‍🏫 Context Matters: The effectiveness of the tool is not uniform. It changes based on the course type, the teaching model, the duration of use, and the role assigned to the AI (e.g., tutor vs. partner). [1][2]

A Cautious Look at the Evidence on ChatGPT in Education

As educators and researchers, we are positioned directly on the front lines of a rapid technological shift. The integration of generative AI, specifically tools like ChatGPT, into our classrooms is no longer a future hypothetical; it is a present reality. The debate surrounding its utility, however, is often polarized, oscillating between utopian promises of personalized learning and dystopian fears of cognitive decline. Anecdotes abound, but robust evidence has been harder to come by.

Beyond the Hype: A Strategic Guide to Using AI in Academic Work and Education

 Summary of Key Points

• 🤔 Which AI to Use?: For serious work, the choice is simple: Anthropic's Claude, Google's Gemini, or OpenAI's ChatGPT. Other tools are specialized or less developed.
• 💰 Free vs. Paid: To access the most capable models required for high-stakes work, a paid subscription (around $20/month) is necessary. Free versions are essentially demos.
• 🚗 System vs. Model: It is crucial to understand the difference between the overall system (e.g., ChatGPT) and the models it offers (e.g., a fast model like GPT-4o vs. a powerful one like o3). Always manually select the powerful model for important tasks.
• 🔬 Deep Research: This feature, which integrates web searching to produce cited reports, is a key capability for professionals. It is more accurate and useful for tasks like creating guides, summaries, or getting a second opinion.
• 🗣️ Voice Mode's Real Power: Beyond conversational chat, the "killer feature" of voice mode in Gemini and ChatGPT is its ability to use your phone's camera, allowing the AI to "see" and comment on your environment in real-time.
• 🖼️ Generation Capabilities: ChatGPT and Gemini can create images. All three systems can generate documents, code, and even simple interactive tools if prompted correctly (using the "Canvas" option in Gemini/ChatGPT).
• ✍️ Modern Prompting: Complex prompt engineering is less important now. The key is to provide clear context (uploading files is effective) and specific instructions. Treat it as an interactive, two-way conversation.
• ⚠️ Troubleshooting & Scepticism: Hallucinations still occur, especially without web searches or when using faster models. It is vital to verify information and remember the AI is a tool, not an oracle. Check the "show thinking" trace to understand its process.

---

Introduction

The rapid evolution of generative AI presents both opportunities and significant confusion for those of us in academia. Every few months, a new model or feature is announced, making it difficult to determine which tools are genuinely useful for teaching and research versus which are merely technological novelties. The discourse is often dominated by abstract fears or uncritical enthusiasm. A more grounded approach is necessary.

Ethan Mollick's recent guide, "Using AI Right Now," offers a refreshingly direct framework for navigating this environment. His analysis moves past the general discussion of "AI" to focus on the practical choices and skills required for effective use. This post will break down Mollick's key insights and translate them into a strategic plan for academics. We will move from selecting the right system to mastering its core functions and, finally, to adopting a productive and critical mindset for AI-assisted academic work. The goal is not to simply use AI, but to integrate it thoughtfully as a capable, if fallible, colleague.

Forget the AI Hype: Two Lessons on What Drives Technology Adoption

Introduction

When a new technology like Artificial Intelligence or rather the Large Language Models like ChatGPT, Claude or Gemini enters our work and lives, our attention is often misdirected. We see a familiar pattern: on one side, there is hype and optimism about solving all our problems; on the other, there is anxiety about control and obsolescence. A third group quickly emerges: self-styled experts who profit from this confusion by selling courses on the technical specifications of the new tools, without telling people why and how they should use the new technology.

This is happening now with AI, just as it did with the personal computer. However, the history of technology adoption teaches a clear lesson. The primary obstacles to implementation are not technical; they are psychological and institutional. Success does not come from understanding the machine itself, but from creating an environment where it becomes genuinely useful. Below I describe the two main barriers to technology adoption, and neither is technical.

Educator Liability Under the EU AI Act: Risks and Requirements for AI-Assisted Assessment

 The EU AI Act transforms educators into regulated operators of high-risk AI systems when using artificial intelligence for student evaluation, creating unprecedented personal liability exposures. Under Article 26(2) of Regulation (EU) 2024/1689, teachers and lecturers deploying AI assessment tools assume direct compliance responsibilities that carry financial penalties up to €15 million or 3% of institutional turnover for violations[8][15]. This legal framework repositions classroom AI use from pedagogical choice to regulated activity with consequences extending beyond institutional liability to individual accountability.

The High-Risk Designation of Educational AI Systems

Regulatory Classification

Annex III(3)(b-d) explicitly categorizes AI systems used for:

1. Learning outcome evaluation (assessment)
2. Academic level assignment (student selection and streaming)
3. Exam behavior monitoring (also called proctoring)

as high-risk applications requiring strict compliance[9][12]. The Act presumes these systems impact fundamental educational rights under Article 14 of the EU Charter, triggering employer obligations regardless of system complexity[6][13].

Rewiring Education: AI, Ethics, and the Future of Learning

 

Introduction

The intersection of artificial intelligence (AI), education, and ethics is no longer theoretical. It is happening in real-time—in classrooms, curriculum design sessions, and national policy debates. As AI systems become increasingly embedded in our teaching and learning environments, we must not only adapt but rethink the entire educational framework.

If we treat AI as just another tool, we miss its transformative potential. AI is reshaping how we learn, how we teach, how we assess, and ultimately, how we define education itself. This post explores three key areas where AI is already forcing us to rethink education: pedagogy and system design, the transformation of the teacher’s role, and the ethical scaffolding required to deploy AI safely and effectively.

---

I. From Tools to Systems: Redesigning Learning with AI

In her interview, Sinead Bovell makes a clear point: AI is not merely a classroom supplement—it is reshaping the entire learning ecosystem. This aligns closely with my own experience designing and piloting AI-powered business simulations in high school economics and business management courses using Flintk12.com (AI4TL, 2024).

In my view, 3 main issues needs to address for successfully merging AI into educational frameworks: 

• safe adoption suited for learners, especially minors,
• effective and transparent use,
• clear guidelines, ethical and critical implementation.

This calls for immediate updates to curricula and assessment, and a comprehensive redesign of education systems. 

This emphasizes that AI should enhance, rather than hinder, educational outcomes. Real-time feedback and self-paced learning were identified as beneficial aspects of AI, while the current challenges involve preventing misuse such as cheating and ensuring that deep learning prevails over traditional rote memorization.

A Simulation-Based Approach

Instead of relying on traditional explanatory lectures or group activities, I introduced adaptive simulations using Large Language Models (LLMs) to facilitate decision-making exercises. It was like role playing but with an AI coach providing immediate and personalized feedback. Linked to the unit's learning objectives, Students assumed executive roles in simulated companies, made strategic decisions, and received immediate, personalized feedback from AI. The results were clear: students were more engaged, took ownership of their learning, and developed skills in a context that mirrored real-world complexity.

Bridging the AI Gap in Education through Prompt Design: An Individual Approach

Summary:

• 🏛️ Schools and universities are historically slow to change, creating a gap.
• 🧑‍🎓 Individuals are adapting to AI faster than institutions.
• 🔑 Prompt design is the key skill, not technical AI knowledge.
• 🌟 Strategic AI use can transform both learning and teaching

With Bing Image Creator

Here is my presentation with sample prompt of AI for educators. 

Bridging the AI Gap in Education: An Individual Approach

Schools and universities, despite their enduring legacy, are often slow to adapt to rapid technological change (see my blog post A Stagnant Sea). The advent of readily available large language models (LLMs) in late 2023 has created a significant gap between institutional AI strategies (or lack thereof) and the potential for individual adoption. This post argues that educators and students can, and should, take the lead. The rewards are enormous, ever imagined your life if you could do a week's work in one day?

A Trojan Horse or a Tool for Transformation?

Background: The AI Tsunami

It's undeniable: Artificial Intelligence (AI) tools like ChatGPT have arrived, and they're not going away. Students are already using them. The question is no longer if AI will impact education, but how. 

Many are rushing to "AI detection" software. However, as the recent MIT Sloan article, "AI Detectors Don't Work. Here's What to Do Instead," clearly states, these tools are unreliable, prone to error, and can lead to false accusations of academic dishonesty. OpenAI, the creator of ChatGPT, even shut down its own detector due to poor accuracy. This begs the question: what should middle and high school teachers do?

Created with Bing Image Creator