What is Distractor Analysis?

What is a distractor?
In Item Response Theory (IRT), a distractor is an incorrect answer option that is included in a multiple-choice question. The purpose of the distractor is to make the question more challenging by providing a plausible answer option for people who don't fully understand the question.
The distractors are chosen to be plausible answers, but not the best answer. They help to identify the test takers who have a good understanding of the subject matter and those who may have guessed the correct answer or have a poor understanding of the subject matter
What is a good distractor?
A good distractor should meet several requirements:
How are distractors evaluated at brght?
At brght, we evaluate distractors by looking at the percentage of test takers who select each answer option (including both the correct answer and the distractors) and the average IQ of the test takers who selected the answer option.
For every question we automatically evaluate the following graphs. The two graphs below belong to a question with good distractors.
The correct answer is selected far more often than the distractors. All the other distractors are selected sometimes, not too often and all in the same range. Option D could be looked at, as only a small percentage of test takers selects this option.
The correct answer is chosen by test takers with a higher IQ than those who select one of the distractors. This is a strong indication that this question will have a high level of item discrimination and will provide a significant amount of information about the IQ of the test taker.
What are simple examples of good and bad distractors?
Question: Who was the President of the United States by the end of 2022?
Good Distractors:
Bad Distractors: