Integrating Chatbots in Course Design

A Practical Guide for Faculty at DCE

Are you thinking about adding a chatbot to your DCE course for students to use?

This guide reviews essential considerations, each with examples and advice, including:

  1. Should I use a Chatbot? Pedagogical Considerations
  2. Chatbot Platform Selection Considerations
  3. Configuring your Chatbot
  4. Privacy and Ethics
  5. Introducing the Chatbot to Students
  6. Frequently Asked Questions
  7. Links to Additional Resources

Please note: Tools, policies, and best practices are still evolving rapidly. If you find an inconsistency or want help walking through things, please feel free to schedule a Course Chatbot Considerations Consultation with the DCE Teaching and Learning staff.

1. Should I use a Chatbot? Pedagogical Considerations

Guiding Principle:  Always use Goals-Centered Design Principles to decide whether a bot fulfills your course goals and learning objectives, just as you would for other learning assets.

Goals and objectives: What are the goals of the course and who are the potential users of this chatbot

Example of course goals and users: Help business professionals at Harvard Extension School apply sustainable financing concepts in their workplace

What are the broad, high-level learning goals for this chatbot?

Example of high-level learning goals of the chatbot: knowledge recall, critical thinking, problem-solving, communication skills

What specific learning objective(s) will this chatbot help achieve?

Example learning objective: “To enhance comprehension and application of the Science of the Diversity Method."

What role will this chatbot play in the learning process?

Tutorbot conveying course information

Assignment/ capstone assistant

Simulation/role play facilitator

Practice problem generator

How might the chatbot enhance student learning experience and outcomes compared to other types of learning interventions? What is the scope and limitation of this chatbot?

Personalized formative feedback, 24/7 availability, interactive practice, enhanced learning engagement and motivation Chatbot will limit its responses to course topics and redirect all other questions to faculty/ the teaching team

How do you want students to engage or interact with the bot (e.g. frequency, types of interaction)? Are there any behavioral guardrails you want to put in place?

Chatbot is intended to provide collaborative problem-solving with learners    Students should interact with the chatbot 15 min per week.    Chatbot should adjust responses based on students' proficiency levels or prior interactions (scaffolding)    The chatbot should create friction to assist in students’ cognitive process (e.g. critical thinking and learning reflection)

How will the chatbot integrate with the existing course structure and content (e.g. learning activities and assessments)? Is the chatbot connected to homework assignments, class discussions, exams? What is your policy of student use of the chatbot during different learning periods (e.g. mid-term and end-of-term exam period)

What are the potential limitations or drawbacks of using a chatbot in this context? What might happen to the students’ learning experience, participation, or performance if something goes wrong? How can you mitigate these concerns?

e.g., over-reliance, inaccurate information, lack of human interaction, engagement and motivation?

How will you measure the effectiveness of the chatbot for meeting your course goals?

e.g., chat and engagement analytics, learning outcomes, teaching team’s observations on knowledge transfer and skills building, survey at the end of the course, question added to course evaluations

2. Chatbot Platform Selection Considerations

The currently approved tools (January 2026) are HUBot and PingPong. In both platforms, the instructor provides Instructions which tells the bot how to interact with students. The instructor can also upload documents with course content information to the platform’s Knowledge base.

Neither platform uses student input to train the LLMs. Any platform not approved by HUIT will need pre-approval from DCE’s IT teams to ensure it satisfies FERPA and security requirements.

Considerations

PingPong

HUBot

Do you need more than one chatbot in your course?

✅ Can create multiple bots per course

✅ ❌ Can only create one bot per course

Do you want students to be able to share threads (conversations with the bot) with you and other students?

✅ Students can share threads

❌ Students cannot share threads

How good is the Canvas integration?

↔️Roster created from class registrants, but not synced to Canvas. Causes access issues if official vs. HKey emails don't match

✅ Installed directly in Canvas; students have automatic access

Does my bot need to be faithful by default to the knowledge base documents I've uploaded? (Note: All bots hallucinate and none can be exclusively restricted to its knowledge base.)

❌ Must use prompt engineering to tell bot to privilege knowledge base

↔️ Bot defaults to emphasize materials in its knowledge base

Will you allow the LLM to access to live Internet sources, beyond the trained data?

✅ Can retrieve new info from the Internet

❌ By default, no access to the live Internet

Is the user interface easy to use?

↔️Some confusion. Instructors report the "temperature settings" and are not intuitive.

✅ No confusion in UI reported

Can students talk to the Chatbot out loud?

✅ Offers Voice Mode/

❌ No Voice mode

Who manages each platform? How do I get access? (Note: DCE does not manage access to either platform)

✅ Request access from the PingPong Team at the Harvard Kennedy School of Government.

✅ Contact HUIT Academic Technology by email.

3. Configuring your Chatbot

Tip: Use our DCE prompt generator tool (beta version) alongside this checklist (i.e. this document) to think through parameters for your bot configuration.

What kind of chatbot responses would promote effective learning? What instructions should you give the chatbot to effectuate these kinds of responses?

Providing scaffolding, hints, explanations, examples; without direct response to support learning

How will the chatbot's personality and tone be designed to align with the course/unit/module's learning goals and learning experience? What instructions should you give the chatbot to effectuate these kinds of responses?

Tone: You are a formal and professional (or friendly and casual; or questioning and challenging) tutor Personality: You are a frustrated customer in the buying process (for a role play)

How will the chatbot handle ambiguous or unexpected student inputs? What instructions will you give the chatbot to interpret these inputs?

Asking clarifying questions, directing students to resources, escalating to someone in the teaching team

Common chatbot issues include hallucination, sycophancy, bias, gibberish, offensive comments, etc. How will the teaching team test the chatbot for accuracy, consistency?

Fact-checking, testing with a wide variety of inputs, expert review, continuous monitoring

How will the chatbot be integrated with the rest of the learning technologies and technical aspects of the learning environment?

Chatbot referenced/used in Canvas, discussion boards, assignments, during web conferences.

How will the teaching team contact the chatbot platform developers in case of serious problems?

Most platform issues should be funneled through you, the instructor.

Will the chatbot support diverse learning needs and cultural backgrounds? How will equitable access be ensured across student tech skill levels?

Inclusive language, varied interaction styles, support for different levels of GenAI familiarity, provide tech alternatives

4. Privacy and Ethics

Privacy: Student input is digitally secure, but if students share their conversation threads with the bots, or if you review their threads, even anonymously, personally-identifying or private data might be exposed.

What types of student information might be inadvertently collected and stored through the interaction with the chatbot? What can you add to the student orientation to the chatbot to discourage students from sharing sensitive personal information?

Students might reveal personally identifiable information (names, student IDs, location details), sensitive academic information (grades, specific academic struggles), or behavioral data (sensitive emotional states such as anxiety, frustration, or stress) during interactions with the chatbot. Refer toHarvard Information Security Guidelines.

How will the teaching team handle student data collected by the chatbot?

No copying outside the chatbot, no emailing, secure storage, limited use, anonymized data.

Does the teaching team own IP for content uploaded to the chatbot?

Confirm ownership, and ensuring compliance with the TEACH Act

How will student plagiarism risks related to chatbot use be mitigated?

Having a clear AI use policy, require students to disclose and attribute. See this resource for tips for encouraging academic integrity with GenAI use.

What will you do if students don't want to use the chatbot for ethical, environmental, data privacy, or other reasons?

Consider whether use is mandatory or optional, and what alternatives students have for fulfilling your course goals.

How will I talk with students about values-driven AI use in general and specifically in this class?

DCE will soon have an AI Literacy Framework to help review ethical considerations, among other issues.

5. Introducing the Chatbot to Students

Is the bot enrollment process aligned with course logistics?

Platform access timing matches syllabus; teaching team knows enrollment steps

How informed is the teaching team (including instructors and TAs) with the support and resources in place for chatbot integration?

HUIT/HKS/DCE support, data policy awareness, technical troubleshooting plan

How will students be introduced/oriented to the chatbot's purpose and use?

Live demo, written/video guide on Canvas, equity-focused orientation for varying GenAI familiarity. Address privacy and ethical use.

What is the mitigation plan if the chatbot fails (becomes unavailable or malfunctions)? Communicate this to staff and students.

Alternative materials/tools/teaching team support, student notification strategy, bot is not to be used for exam prep

6. Frequently Asked Questions

Common Faculty Questions About Using Chatbots at DCE

The following addresses common faculty questions not already covered elsewhere in this resource. It reflects current policy (January 2026), technical guidance, and support structures at DCE and Harvard.

How do I copy a bot from one course to another?

There is no direct way to copy a chatbot between courses, but you are free to copy and paste the bot instructions and knowledge base from one bot instance to another.

What is "RAG" and how is it being used in the chatbot?

RAG stands for Retrieval-Augmented Generation—a method where the chatbot uses a special knowledge base to ground its responses. Without RAG, a bot only "knows" what it has learned from its original training. RAG allows you to privilege certain accurate information over the general noise of the internet, or to tell it details about your course and syllabus.

What is the intellectual property (IP) policy for material used for the system prompt and RAG?

Any documents uploaded for RAG in your chatbot must be either owned by the teaching team, used under an appropriate license, or are otherwise covered as fair use under the TEACH Act (i.e. the same policies that cover what you can upload to your Canvas site).

What data, according to the university security policy, can I use to configure a chatbot?

Only data classified as Level 1 or 2 (public or low-risk internal data) should be used to configure chatbots unless explicitly approved. Do not use any data that includes student grades, IDs, or personally identifiable information unless authorized. For Level 3+ data, notify the DCE Teaching & Learning team for guidance.

Can the chatbot adapt to students with different proficiency levels or learning needs?

Yes—many chatbot platforms can be designed to scaffold responses, offering varying levels of support based on how students interact with the tool. When well-configured, a chatbot can tailor explanations, provide prompts, or adjust complexity depending on the learner's background. You can instruct the chatbot to prompt the user to check their comfort/knowledge level. Consider including adaptive features in the bot's system prompt and testing with diverse users.

How much time and effort will be required to set up, train, and maintain the chatbot?

Setup time can vary widely. A basic configuration may take under an hour, while developing and refining a bot aligned with course learning goals can take several weeks and multiple human testers. Testing and iteration—especially for accuracy, tone, and instructional fit—requires time. The DCE Course Design team is available to support this process.

Is it okay to use chatbot outputs as part of student assessments or assignments?

Yes, but with clear expectations. If students are allowed to incorporate chatbot responses into assignments, they should comply with your policy on acceptable use, give proper attribution, and attend to privacy and other ethical concerns. Be mindful of potential plagiarism risks.

Can I customize a chatbot's tone or personality to match my course style?

Yes! Your instructions can define the chatbot's tone, voice, and personality through the system prompt or configuration settings. You can also upload samples of your writing style to the knowledge base. You can tailor it to be more formal, conversational, encouraging, or even role-specific (e.g., a mentor or lab assistant), depending on your course environment and learning goals. This is often one of the most effective ways to align the chatbot with your teaching style.

Who is my point of contact when there is a technical difficulty?

For technical issues, contact the team who supports the platform. Generally, tech support is available for faculty, but not students. The DCE Course Design team can assist with pedagogical and design-related questions.

7. Additional Resources

Harvard and DCE Policies

Teaching with AI

Academic Integrity