Skip to main content

Analytics & Course Improvement

How OneTutor helps you to improve your course for the long term.

Written by Tobias Maier

At OneTutor, our goal is to improve teaching sustainably and based on evidence. We achieve this through a closed feedback loop between instructors and learners.

What this means in practice:

  • Deep understanding of the questions that truly occupy your learners' minds.

  • Quantitative assessment of how well specific topics and questions are understood.

  • Data-driven continuous development of course materials and quiz questions.

All insights are pseudonymized: you see what learners ask and how they perform, but not who they are.

How Can I Use Quiz Information?

Dashboard

In the dashboard, you get a quick overview of:

  • general usage statistics of your learners,

  • which topics are practiced most frequently,

  • how successfully questions within these topics are being answered.

For each topic you see how many submissions there were and how successful they were.

Dashboard with usage statistics and topic overview

Tip: For a detailed understanding of specific knowledge gaps, it is well worth checking the Quiz Overview regularly.

Quiz Overview

There you can identify:

  • which questions are answered particularly well or poorly,

  • which questions might be unclear or flawed.

Quiz Overview with questions, average score and reported issues

  • You can view the average score that learners achieved on each question.

  • For each individual question you see which answer options were chosen and how often learners asked for a hint with "Help me".

  • Sorting the questions by score allows you to instantly identify easy and difficult questions, or flag potentially problematic ones.

  • The "reported issues" come directly from learners who gave the question a negative rating. Each person can rate a question once, and later changes replace the earlier rating.

Use these insights directly to revise and improve your questions in a targeted way.

How Do I Use the Insights from the Chat?

OneTutor gives you insight into the questions that actually occupy your learners' minds (questions that often remain unasked in traditional settings).

Benefits for teaching:

  • Significantly more questions compared to course forums or in-person sessions.

  • Lower barrier to entry for learners to ask for clarification.

  • Realistic insights into learners' mindsets, roadblocks and misconceptions.

Further down the dashboard, you will also see a running list of recently sent messages alongside the AI-generated responses.

Chat log: You can read individual conversations in full, with formatting and source references. The log can be filtered by the type of conversation, for example by hints from the quiz.

FAQ

In the dashboard, OneTutor summarizes frequently asked questions from your learners. Similar questions are grouped by meaning. For each group you see how often the question was asked, a model answer, and how well your material covers the topic. This shows you at a glance which topics repeatedly cause confusion, so you can adjust your material or your teaching in a targeted way. The analysis is pseudonymized.

Pedagogical application: Reviewing recent questions is an excellent way to identify unresolved points after a course break and to address them directly in the next teaching phase. It can also serve as a weekly review to start your next live session.

Quality assurance and improvement: You can also review the AI's answers. If you notice deviations from your preferred terminology or style, you can correct them in the instructions for the chat in your course settings. Each instruction covers one point, for example "Always write code in Java", or a fact such as the exam format. This way the instructions grow with your course. If answers drift too far from the course material or stick too closely to it, also adjust Material Adherence (Edit course → Advanced settings).

Did this answer your question?