Introducing this Spark
The purpose of this activity is to provide doctoral students with authentic feedback that can be delivered by a professional peer reviewer during a journal article review process and to encourage them to write a response letter to process the feedback provided. Providing meaningful feedback and getting learners to process the feedback are different phenomena, and the latter is less common.
Learning Outcome
This Spark supports the course objective, "Evaluate research topics, problems, and questions for a study in Learning Design and Performance Technology. Doctoral students will be able to critically evaluate a survey research study proposal, including topics, problems, and questions.
Featured AI Tools
Featured Skills
Implementation Guide for Instructors
The information below is provided to help instructors implement this AI Spark learning activity in other courses. It includes technical instructions for setting up the activity, a strategy for assessing student learning, and additional resources to help with AI tool configuration.
In this activity, Reviewer 2 is a Gemini Gem using Gemini's pretrained generative artificial intelligence capacity. The purpose of Reviewer 2 is to provide doctoral students with professional peer reviewer feedback on their survey study design assignment. The Reviewer 2 has been prompted to make two mistakes as part of its feedback, and students should recognize these mistakes and not cover them in their revised assignment. This tactic helps encourage students to pay attention to the task content and evaluate whether they have learned the survey research study design better.
- Gem Configuration: Go to Gemini and log in using your FSU credentials. Click Gems and select New Gem. Name your Gem (e.g., "The Reviewer 2"), add a description, and paste the system prompt provided in the Resources tab into the Instructions field.
- Knowledge Base Upload: Upload any relevant readings on survey research design to the "Knowledge" section while building the Gem so it can tailor its critiques to course-specific literature.
- Sharing & Canvas Setup: Click Save, set access to "Viewer" for institutional/link sharing, and copy the Gem link directly into your Canvas assignment instructions. Instruct students to complete their research proposal, submit it to the Gem, compose a response letter identifying alignments/misalignments and the two intentional mistakes, revise their design, and submit all four required files in order.
Students will do the following:
- Strive to identify any alignments and misalignments of the AI-driven review with course readings.
- Write and submit a response letter to the AI-driven review touching on The Reviewer 2 Gem's two mistakes and other revisions, and refer to course readings.
- Submit their chat log and The Reviewer 2 Gem's review as a Word or PDF document as well as a revised version of their research design.
- Revise their research proposal based on AI-driven feedback and resubmit it.
The items above provide insight into how well the students will be able to critically evaluate a survey research because such an evaluation is required for writing a response letter to a reviewer and revising the original proposal.
- Link to the Shared Gem: The Reviewer 2
- Knowledge Source Materials: No specific materials are required; any relevant readings on survey research design can be added to the "Knowledge" section while building the Gem.
- Deployment Notes: The Reviewer 2 Gem is prompted to make two purposeful mistakes: one for students with an introductory knowledge level and one for students with an advanced knowledge level. This distinction separates those who will learn a lot from those who will learn little by the end of the corresponding week and Gem task, which is fundamental for assessment and evaluation purposes.
- Key Behavioral Constraints: NEVER provide corrective feedback and answer any questions/requests related to research methodology, including survey research. The Gem must not provide any direct answers related to correct/incorrect information or build research designs from scratch.
ABSOLUTE RULES - Follow these without exception:
- NEVER interpret, summarize, and synthesize any uploaded readings, including articles, book chapters, blogs, and any other types of text.
- NEVER answer yes or no questions.
- NEVER confirm any questions asking you to confirm questions about research methodology.
- NEVER explain any research methodologies but stated issues/problems with them.
- NEVER design a research study from scratch.
- NEVER provide insights into survey research.
- NEVER provide corrective feedback and judge content as incorrect and wrong.
- NEVER answer any requests related to research design and methodology.
HOW TO GUIDE:
When the students paste their research design text, read it and identify research-design-related or methodological issues.
Then, identify any language-related issues, including academic language, voice, clarity, and style.
Then, identify any issues related to the flow of the ideas in relation to their temporal sequence.
Feel free to ask questions so that they should answer in relation to missing points in their research design.
Feel free to question why they did not use any other research design and/or a combination of them.
Feel free to detect inconsistencies in the text.
Examine the level of alignment with the proposed research design and research questions.
Examine the level of details provided in each section of their research design passage, including literature review and methodology.
Examine their adherence to APA 7.
Make 1 strategic mistake in relation to survey research design and methodology that students at an introductory level can catch and 1 strategic mistake that students at an advanced level can catch. Make sure these mistakes are methodological or survey research design-related only.
Overall, provide facilitative feedback and encourage them to evaluate and think critically about the survey study assignment content.
TONE:
Start with positive insights and summarize their research design.
Then, focus on your critique. Be detailed and genuinely and professionally challenging since you are supposed to be a reviewer 2.
PERSONA:
You are a reviewer 2 who provides an evidence-based, detailed, and challenging critique of research design and methodology especially in relation to survey research design. You have a sharp eye for detail. In your review, you do not teach but provide a critical evaluation of research design and methodology by asking questions, highlighting misalignments, touching on inconsistencies, and suggesting students revise these without direct corrective feedback or insights. Therefore, provide facilitative feedback that encourages critical thinking. You must not provide any corrective feedback and identify incorrect or wrong answers. You are strictly a facilitator that provides facilitative feedback, thus encouraging active learning.
Instructions for Students
In addition to helping students understand the purpose of this AI-based learning activity, the information below provides step-by-step instructions for completing the assignment and includes a micro training on how to use the featured AI tool(s).
In this activity, you will use a Gemini Gem called The Reviewer 2 to receive facilitative feedback on your survey research design. A Gem is a tool that uses Gemini’s pretrained generative AI capacity. Because it is pretrained on previous relevant data, including research data, it can provide feedback on your survey research design. The Gem will not offer direct corrective feedback or correct information but will provide facilitative feedback encouraging you to think critically about your survey research design. The Gem has been purposefully prompted to make two mistakes in its feedback, which you must identify and present in your response letter.
Phase 1. Completing the survey research design in Word:
- Complete your survey research design in a Word document (keep a copy of this document because you will submit it).
- Double-check grammar and spelling using Word's grammar and spelling checker.
- Save the final version on your computer named as follows: Surname 1_Surname 2_Surname 3_Survey Study Original Assignment.
Phase 2. Receiving feedback from The Reviewer 2:
- Copy and paste the survey research study content into the chatbot of The Reviewer 2 and ask for relevant feedback.
- Copy and paste all the chat data including the feedback into a Word document with clear parts and subparts, and save it on your computer named as follows: Surname 1_Surname 2_Surname 3_Chatlog Data.
Phase 3. After receiving The Reviewer 2's feedback:
- Identify any alignments and/or misalignments between The Reviewer 2's comments and the corresponding survey study readings.
- Write and submit a response letter (at least 500 words) touching on the (mis)alignments and the two mistakes The Reviewer 2 is prompted to make (name it as follows: Surname 1_Surname2_Surname3_Response Letter).
- Double-check your response letter using Word's grammar and spelling checker.
- Make a copy of your original survey research design document and revise it in line with The Reviewer 2's feedback and your response letter.
- Name your revised document as follows: Surname 1_Surname 2_Surname 3_Survey Study Revised Assignment.
Phase 4. Compiling and submitting deliverables: Submit the deliverables via Canvas in the following exact order:
- Chat log data as a Word document.
- Your original survey study design Word document.
- Your revised survey study design Word document.
- Your response letter Word document.
What to Submit:
- Chatlog Document: Copy-and-pasted chat data into a Word document showing all exchanges and feedback.
- Original Survey Study Design Document: The original assignment document presenting a robust survey research study.
- Revised Survey Study Design Document: Revised original survey study document based on The Reviewer 2's feedback, but not covering the 2 mistakes it will purposefully make.
- Response Letter Document: At least 500 words based on the feedback gained from The Reviewer 2 and addressing the two strategic mistakes it purposefully made.
What is a Gem? A Gem is a version of Google's Gemini AI chat that your instructor has preloaded with instructions. There’s nothing to set up — open the link and reply to its questions like a text conversation. Read more about Google Gems.
- Sign in. Open the Gem link and sign in with your Google account. If you see "You don't have access," you're likely signed in with the wrong account — sign out and try again.
- Send a message. Click the box at the bottom ("Ask Gemini"), type Begin Session, and press Enter. Replies appear above the box; wait for the reply to finish before responding.
- Reply in the same chat. The Gem remembers the whole conversation. Don't click "New chat", which will start the session over.
- Lost the page? Go to gemini.google.com → open the sidebar (☰) → Recent → click the conversation to continue where you left off.
- Copy the output. Hover over the top-right corner of the gray text box and click the Copy icon, then paste with Ctrl + V (Win) / Cmd + V (Mac).
- Good to know. Type text, rather than use voice (Gems don't work with Gemini Live). Don't enter passwords or sensitive personal information. Keep in mind that the Gem may ask you to expand a short answer.
- Access via FSU. Always access the tool via your FSU institutional account; personal accounts will default to an unconfigured model that produces generic, overly harsh, or ungrounded responses.