A loyal reader, who agrees with me that we may be teaching and testing medical students and residents the wrong way, asks why aren’t all board recertification examinations given orally. She correctly asserts that oral examinations are better because they assess how people think rather than how much they have memorized.
Here’s why it would be difficult to do.
The initial surgery board exam is given in two parts. First a written exam must be passed. Those who pass it are tested orally at one of four or five different times and locations within the following year. Oral exams are quite labor intensive.
Each candidate is examined by three pairs of surgeons, consisting of a senior examiner who is a member of the board itself and a surgeon from the local area. Each session lasts 30 minutes per pair for a total of 90 minutes. Multiply that by 1,300+ examinees per year.
I had the privilege of serving as an examiner on one occasion. It’s very stressful because one wants to be fair but also not let incompetent surgeons become certified. It’s also much harder to standardize oral exams. Scenarios used in the exam are chosen by the board each year, but the individual examiners may have different approaches to the way the questions are asked and answered. For a number of surgical diagnoses, there may be more than one correct way to handle a problem, which makes creating a written exam difficult too.
About 1,800 to 2,000 general surgeons take the recertifying exams every year. To give each one of them a 90-minute oral exam would be very expensive and time consuming. It would be hard to find practicing surgeons willing to give up so much time to be examiners.
Many surgeons and other specialists are complaining about the cost of maintaining board certification. Taking a written recertification exam now involves going to a testing center and sitting in front of a computer. Many such centers exist, and traveling to them is much less complicated than going to one of the four or five cities where the oral examinations are held every year.
I do not see any way that recertification exams can ever be even partially oral. Until someone finds a way to make computer-based exams more clinically oriented, the ability to memorize facts will remain the basis for all recertification testing.
There are other issues such as how to deal with surgeons who have specialized in a narrow area of surgery for many years, which is becoming more prevalent with so many graduates of residencies taking fellowships.
I addressed the other maintenance of certification components in a post last year. The concept of maintenance of certification is noble, but the execution is not working for those subjected to the process.
If anyone has a better idea, please comment.
“Skeptical Scalpel” is a surgeon blogs at his self-titled site, Skeptical Scalpel.
