A quiz that frustrates learners or fails to test real understanding doesn’t just hurt your course ratings. It undermines the reason people enrolled in the first place.
Research backs this up.
A study published by Roediger & Karpicke (2006) found that students who took practice tests retained 50% more information after a week than those who simply restudied.
How you test matters as much as what you teach.
This guide shows you how to build them properly in WordPress using Masteriyo, from your first question to advanced settings like time limits, question banks, and AI-generated quizzes.
What Makes a Good Quiz in an Online Course
A quiz that’s too easy gets ignored. One who feels disconnected from the lessons loses learner trust fast. Getting the balance right comes down to a few basic decisions.
Question variety matters more than question count. Multiple choice test recognition. Open-ended questions test actual understanding. Using both gives you a clearer picture of where your learners stand.
Set a pass mark and communicate it upfront. Learners perform better when they know what’s expected. A clear target is more useful than a surprise at the end.
Time limits and attempt rules encourage preparation. Without them, learners can brute-force their way through. A passing score means nothing if it took fifteen attempts to get there.
Every question should trace back to a lesson. If you can’t point to where in your course that question was covered, cut it.
Getting Started with Masteriyo’s Quiz Builder in WordPress
Masteriyo’s core quiz builder comes included in the free version of the plugin. You can create quizzes, add multiple question types, set pass marks, and control attempt limits without needing a paid plan.
To access the quiz builder:
- Go to Masteriyo > Courses in your WordPress dashboard
- Open an existing course or create a new one
- Navigate to the Builder tab
- Under any section, click Add New Quiz
Masteriyo organizes courses into sections, and quizzes sit at the same level as lessons. You can place a quiz anywhere, after a single lesson, at the end of a section, or as a final course assessment.
Creating Your First Quiz
When you add a quiz in Masteriyo, the editor walks you through three steps: Info, Questions, and Quiz Settings.
Info: Give your quiz a name and an optional description. This is what learners see before they start, so keep the name clear and relevant to the lesson content.
Questions: This is where you add your questions. You can either create new ones from scratch or pull from your question bank if you’ve built one up. We’ll cover both in the next section.
Quiz Settings Once your questions are in place, this is where you configure how the quiz behaves.
- Pass Mark: The minimum score a learner needs to pass, set as a percentage
- Time Limit: A countdown timer. Leave it off for self-paced courses
- Attempts Allowed: Set to 1 to encourage preparation, or leave unlimited for low-stakes practice quizzes
- Reveal Correct Answers: Let learners see correct answers after submitting
Adding and Managing Questions
With your quiz created, you have two ways to add questions: create one from scratch or pull from your question bank.
Adding a New Question
Click Add New Question and select a question type. Each question has three fields:
- Question Name: The actual question you’re asking
- Question Description: Optional context or additional detail to help the learner understand what’s being asked
- Points: The marks assigned to that question. Masteriyo uses these to calculate the learner’s total score against the pass mark you set earlier
Once filled in, hit Update to save the question before moving to the next one.
Question Types Available
True/False Straightforward yes or no questions. You can add an answer explanation that learners see after submitting, which makes it useful for reinforcing the reasoning behind a correct answer.
Single Choice: One correct answer from multiple options. Good for testing specific facts or concepts where only one answer is definitively right.
Multiple Choice: Same format as single choice, but learners can select more than one correct answer. Works well for questions where understanding involves recognizing a combination of factors.
Text Answer (Pro): Learners write out their answer in their own words. You can set a maximum character limit. Best used for open-ended questions that require explanation rather than selection.
Fill in the Blanks (Pro): Learners complete a sentence by filling in the missing word or phrase. Useful for testing recall of specific terms or definitions.
Match the Following (Pro): Learners match prompts to their correct answers. Supports text-to-text, image-to-text, and image-to-image matching.
Sortable (Pro): Learners arrange a set of answers in the correct order. Good for testing understanding of sequences or processes.
Audio and Video Questions (Pro): Attach an audio clip or video to a question. Supports self-hosted files, YouTube, Vimeo, and external URLs.
Using the Question Bank
The question bank lets you reuse questions across multiple quizzes without recreating them each time. Click Add from Question Bank to browse existing questions.
You then have two options:
- Add to Quiz: Moves the question into the quiz and removes it from the bank
- Duplicate and Add to Quiz: Copies the question into the quiz and keeps the original in the bank
For most cases, duplicating is the safer choice if you plan to use the same question elsewhere.
Advanced Quiz Settings
After adding your questions, head to the Quiz Settings tab. It covers two things: how the quiz is scored and how it’s presented to learners.
General Settings
Full Points and Pass Points: Masteriyo adds up points based on what you assigned to each question. You can set the total manually or use Auto Calculate to have it figured out for you.
Then define the minimum points needed to pass.
For example, 5 questions at 10 points each give you a total of 50. A pass point of 30 means a learner needs to get at least 3 right.
Duration: Sets a countdown timer. When time runs out, the quiz submits automatically with whatever the learner has answered. Skip this for self-paced courses where a timer adds no real value.
Attempts Allowed: Controls how many times a learner can retake the quiz. Enabling
Reveal Mode: Enabling this limits the number of attempts and shows correct answers after submission. It’s a good fit for final assessments where you want learners to review their results after a genuine first try.
Display Settings
Questions Per Page: controls how many questions a learner sees at once. You can inherit the global setting or customize it per quiz. For longer quizzes, breaking questions into pages keeps things from feeling overwhelming.
Randomize Questions: Shuffle the question order for each learner. Worth turning on if your learners are likely to attempt the quiz more than once or share answers with each other.
Show Result: When on, learners see their score immediately after submitting.
Creating Quizzes Faster with AI
Building a multi-section course means a lot of quiz questions to write. Masteriyo’s OpenAI integration can handle the first draft.
The feature is part of Masteriyo Pro. Once you connect your OpenAI API key, you can generate a full course, quizzes included, from a single prompt.
What you control:
- Number of quizzes per section
- Number of questions per quiz
- Which question types to include
The AI generates questions based on your course topic. It supports all major question types, including Text Answer, Fill in the Blanks, Match the Following, and Sortable, added in Masteriyo Pro 3.0.
Before you publish: AI-generated questions can be generic. Review each one against your actual lesson content and rewrite where needed.
Tips for Writing Better Quiz Questions
Good questions are harder to write than they look. A few things worth keeping in mind:
Test understanding, not memory. “What year was X introduced?” tells you nothing useful. “Why did X replace the previous approach?” tells you whether the learner actually understood the lesson.
One idea per question. Questions that bundle two concepts together make it impossible to know which part a learner got wrong.
Wrong answers should be plausible. If three of your four options are obviously incorrect, you’ve written a recognition exercise, not a quiz.
Read each question cold. If you have to already know the answer to understand what’s being asked, rewrite it.
Keep the language simple. Complicated phrasing tests reading comprehension, not course knowledge.
What to Do Next
Quizzes are worth the time you put into them. A well-built quiz reinforces what learners studied, gives you a clear picture of where they stand, and makes your course more valuable overall.
Masteriyo gives you the tools to build them properly, whether you’re starting with a simple true/false question or setting up a timed assessment with a question bank behind it.
The free version covers the basics. As your courses grow, the Pro features, question bank, advanced question types, and AI generation are there when you need them.
Start building with Masteriyo →