In February, IBM supercomputer Watson won Jeopardy! against its two human opponents, Ken Jennings and Brad Rutter.

Watson’s victory rests on its power in speech recognition and the ability to understand colloquial human language used in game shows like Jeopardy!. The most interesting development of this story is that after Watson’s celebrated win on national television, IBM will partner with Nuance Communications to explore how Watson could help with medical diagnosis and treatment in a hospital setting, using speech recognition and the ability to quickly index data from case studies and medical histories of patients.

This development begs the question: when will computers get so good at doing our job that they should replace humans?

To answer this question, we look at the second article written by Garry Kasparov, the chess grandmaster who battled the famous Deep Blue, a supercomputer programmed by a full team of humans to play chess. Kasparov’s career spans a pivotal period when computers progressed from a weak chess player to an unbeatable one. But the most interesting finding of all was the fact that when weak human players team up with a few average computers, they are superior to chess grandmasters or the best supercomputers alone.

Kahneman, a Nobel Laureate in Economics, explained why this is by characterizing how human intuitions work. First, good intuitions take years to attain – a study by Chase et al showed that chess players take 10 years of dedicated study and competition to possess a good mental collection of board patterns that allow players to identify a good move without calculating all possibilities.

Second, intuitions are easily affected by biases or the way information is presented. One example is the anchoring phenomenon. When people are asked “Is the average price of German cars more or less than $100,000?” before giving an estimate of the average price of German cars, participants will “anchor” around Mercedes and high-end cars when estimating. On the contrary, when another group of respondents are asked a different anchoring question “Is the average price of German cars more or less than $30,000?” they anchor around cheaper cars and give a lower estimate.

Third, human intuitions are inconsistent. A study by Goldberg created simple diagnostic algorithms based on the criteria used by 29 psychologists to distinguish neurotic from psychotic patients. These 29 psychologists then compete with algorithms built from their knowledge to distinguish new sets of patients. Researchers found that algorithms differentiated neurotic from psychotic patients more accurately than psychologists from whom the models were derived. Kahneman believed that this is because human judgments are inconsistent.

Last and most importantly, intuitions only work in a limited environment that provides good cues and rapid feedback. This explains how a team of weak human players and average computers becomes so powerful. In this setup, humans use accurate cues and rapid feedback provided by computer calculations to make decisions. The key is a good process with humans and computers playing to each other’s strengths – computers are better at processing information, while humans are better at strategic planning.

The advancement of computers creates an impending shift in how we practice medicine. As we strive to limit human errors and stretch limited resources to expand health care access to underserved areas, computers play an important role. To reduce medical errors, computers can help physicians concentrate on strategic thinking instead of recalling medical knowledge from memory. To increase access to care, we can rely on a team of health workers aided by computer algorithms for simpler medical problems, while referring to human physicians and their intuition to override preformed computer algorithms for more complicated cases.

Overall, considering the fact that common medical conditions are common, the role of physician experts will change as we rely more on computers and mid-level health professionals. This shift should free doctors to fulfill a bigger, more complicated role in health care that has yet to be determined.

Like Ken Jennings once quipped as part of his Final Jeopardy answer, “Welcome our new (doctor) computer overlords.”

“angienadia” is an internal medicine physician who blogs at Primary Dx.

Submit a guest post and be heard on social media’s leading physician voice.