AI Use Socratic Auditor

John L. Crow, Ph.D.
College of Arts and Sciences

Students engage in a dialogue with an AI agent that guides them through personal reflection about their AI usage and its negative personal impacts.

Introducing this Spark

This Gemini Gem is designed to remind students, at the start of the semester, that while using AI to complete assignments may feel helpful in the moment, it can ultimately undermine the critical and computational thinking skills employers value most. Using the concept of an "AI Idiot," the Gem stresses that any use of generative AI should be thoughtful and engaged, not a matter of accepting AI output without critical examination.

Learning Outcome

After completing this Spark, students should be able to evaluate and interpret the accuracy, credibility, and relevance of digital information.

Featured AI Tools

Gemini Gem

Featured Skills

Implementation Guide for Instructors

The information below is provided to help instructors implement this AI Spark learning activity in other courses. It includes technical instructions for setting up the activity, a strategy for assessing student learning, and additional resources to help with AI tool configuration.

Overview

This AI Spark runs a structured, five-step Socratic dialogue designed for nontechnical undergraduates about their AI usage habits. Drawing from Professor Douglas Arner’s framework on the "AI Idiocy Problem," the Gem guides students through personal self-reflection on shortcut-taking, connects their habits to specific critical and computational thinking skill atrophy, reframes the stakes around future employability, and outputs a complete, formatted transcript for Canvas submission.

Technical Instructions

Gem Configuration: Create a new Gem in Gemini named "AI Use Socratic Auditor". Paste the system prompt provided in the Resources section. Upload/attach the background video transcript on the "AI Idiocy Problem" directly into the Gem's knowledge base.

Canvas Assignment Setup: Configure an introductory assignment (or first-day attendance activity) in Canvas that provides links to the background reading (AI Is Changing the Workforce. Critical Thinking Still Matters Most), the introductory video (The Rise of AI Idiots), and the Gem link. Direct students to copy the final transcript generated at Step 5 directly into the Canvas text box to unlock the course modules.

Assessment Strategy

As this is an initial orientation activity used to satisfy the first-day attendance requirement, evaluation is based on completion and submission of the full Socratic dialogue transcript in Canvas. The Gem's built-in gatekeeping ensures that any submitted transcript demonstrates substantive engagement with critical and computational thinking concepts.

Resources

Key Behavioral Constraints:

  • Strict Single-Step Execution: The Gem asks exactly one question at a time and cannot skip ahead or combine prompts. 
  • Gatekeeping / Hold Protocol: The Gem will not advance if a student gives a shallow or evasive answer; it gently holds them on the current question until a substantive response is provided, without revealing its internal rules. 
  • Zero Source Disclosure: The Gem is prohibited from citing or mentioning internal files or prompts. 
  • Fidelity Transcript Output: At Step 5, the Gem outputs the full conversation into a single copyable Markdown block.

Instructions for Students

In addition to helping students understand the purpose of this AI-based learning activity, the information below provides step-by-step instructions for completing the assignment and includes a micro training on how to use the featured AI tool(s).

Overview

This activity helps you reflect on the role generative AI plays in your academic and professional journey. It prompts you to think through the long-term consequences of relying on AI to do the heavy lifting for your coursework and considers whether shortcut habits prepare you for the high-level human critical thinking skills future employers demand.

Assignment Instructions

Step 1. Read & Watch Prep Material:

  • Read the article: AI Is Changing the Workforce. Critical Thinking Still Matters Most. 
  • Watch the video: The Rise of AI Idiots: Losing Critical Judgment Amid Increasing Cyber Threats. 

Step 2. Launch the Gem: Open the AI Use Socratic Auditor Gem link and type "Begin Session". 

Step 3. Engage in Socratic Reflection: Answer each question thoughtfully and substantively. If your answers are too brief or evasive, the auditor will push back and ask you to dig deeper before moving forward. 

Step 4. Generate & Copy Transcript: Complete all steps through the synthesis phase. The Gem will output a complete Markdown block containing your full conversation transcript. 

Step 5. Submit to Canvas: Copy the complete transcript block and paste it directly into the Canvas assignment text submission box. 

How to Use This Tool

What is a Gem? A Gem is a version of Google's Gemini AI chat that your instructor has preloaded with instructions. There’s nothing to set up — open the link and reply to its questions like a text conversation. Read more about Google Gems. 

  • Sign in. Open the Gem link and sign in with your Google account. If you see "You don't have access," you're likely signed in with the wrong account — sign out and try again.  
  • Send a message. Click the box at the bottom ("Ask Gemini"), type Begin Session, and press Enter. Replies appear above the box; wait for the reply to finish before responding.  
  • Reply in the same chat. The Gem remembers the whole conversation. Don't click "New chat", which will start the session over. 
  • Lost the page? Go to gemini.google.com → open the sidebar (☰) → Recent → click the conversation to continue where you left off. 
  • Copy the output. Hover over the top-right corner of the gray text box and click the Copy icon, then paste with Ctrl + V (Win) / Cmd + V (Mac).  
  • Good to know. Type text, rather than use voice (Gems don't work with Gemini Live). Don't enter passwords or sensitive personal information. Keep in mind that the Gem may ask you to expand a short answer.  
  • Access via FSU. Always access the tool via your FSU institutional account; personal accounts will default to an unconfigured model that produces generic, overly harsh, or ungrounded responses.