AI holds a particular appeal in the realm of healthcare due to the major inefficiencies with the status quo and the excitement around what could be possible as quality data becomes available at exponentially increasing rates. Among many use cases, AI can assist physicians in staying up-to-date on the most recent and relevant scientific studies, reduce human errors when diagnosing patients, and leverage large population health datasets when predicting outcomes . The inputs available today are categorized as either structured or unstructured data. Machine Learning (ML) works best with structured data such as diagnostic imaging, genetic testing and electrodiagnosis, while Natural Language Processing (NLP) works to extract information from unstructured data sources such as physical exam notes and clinical laboratory results .
In 2012, IBM formed a partnership with Sloan Kettering to use IBM’s NLP technology named Watson Health to develop a clinician decision support tool for treating oncology patients . Executives at Sloan Kettering were eager to leverage Watson’s ability to read 200 million pages of data and produce a well-analyzed result in 3 seconds to help clinicians stay abreast of the cutting edge research and scientific studies when diagnosing and treating oncology patients . The ability to rapidly review and interpret the latest scientific studies is of paramount importance. Each year, tens of thousands of oncology research papers are published every year, amounting to over 100 new papers everyday . Clinicians are physically unable to keep up with the rapidly accumulating information, creating the opportunity for Watson to assist oncology clinicians in summarizing relevant research. In the short term, Sloan Kettering has sought to address this problem of rapidly accumulating research with a limited ability to translate the information into improved patient care by collaborating with Watson on a diagnostic support tool.
Challenges over recent years have cast doubt on Watson’s ability to meet its high expectations, leaving an unclear path forward for Sloan Kettering. The root cause of the disappointment is the underestimated complexity of training the software. In interviews conducted with STAT in 2017, Sloan Kettering’s lead Watson trainer, Dr. Mark Kris, complained of the painstaking time required of the physicians who are helping to train the data to input their own recommendations into Watson . Not only is this resource intensive for hospitals to take on with the hope of increased efficiencies in the future, but there runs the risk that the outputs are only as good as the inputs – meaning if the physician operators input incorrect diagnoses into Watson, then the future outputs will also be faulty. Further complicating the success of the partnership are the frequent changes in the broader healthcare landscape that may require overhauls in the system. For example, Dr. Kris referenced recent changes to treatment protocols for metastatic lung cancer patients that changed protocols worldwide within a week . While Watson may be able to ‘read’ staggering amounts of data in seconds, getting to that point of speed and accuracy requires significant amount of manual inputs of new literature and patient cases – a process that must be repeated for each type of cancer the product intends to serve. Over the short-term Sloan Kettering has collaborated on a product that is still in its stages in infancy. Moving forward into the medium term, the cancer center remains dedicated to its partnership despite the slow progress.
The inherent risk of launching a massive commercialization effort for an AI technology before it is fully developed and its efficacy is rigorously proven, is that distrust between AI software developers and health care providers could limit future adoption of effective AI solutions. In addition to pursuing this clinical decision support tool, I would encourage healthcare providers like Sloan Kettering to explore the adoption of AI in other realms of patient care. In contrast to the NLP deployed by Watson Health for Oncology, GE has been developing a suite of ML technologies that couple well with their diagnostic imaging machines. In the summer of 2017, GE entered into a 10-year partnership with Partners Healthcare in Boston to build a bridge between GE developers and clinicians to create products that assist doctors with a variety of functions starting with interpreting medical images . Diagnostic imaging by humans has a high error rate  and the structured data typically makes for relatively easier product development. The success of the Partners and GE partnership is yet to be determined, but moving towards more agile, high impact products seems like a step in the right direction.
As a member of the executive team at a hospital, at what point do you decide that a collaboration has cost too much and yielded too little? As a patient, how would you feel about your physician using a diagnostic support tool for oncology compared to your radiologist using a diagnostic imaging support tool? (799)
 Jiang F, Jiang Y, Zhi H, et al. Artificial Intelligence in Healthcare: Past, Present and Future Stroke and Vascular Neurology. 2017; 2:doi: 10.1136/svn-2017-000101
 Bowman, D. (2013). New watson-based tool sends docs to the cloud for cancer treatment. FierceHealthIT, Retrieved from http://search.proquest.com.ezp-prod1.hul.harvard.edu/docview/1466241812?accountid=11311.
 Hirsch, Marla Durben. (2012). Memorial Sloan-Kettering, IBM Partner on Latest Watson Technology Project. FierceHealthIT.com
 Gachon University Gil Medical Center Adopts IBM Watson for Oncology Trained by Memorial Sloan Kettering, Marking Watson’s First Deployment in Korea. (2016, Sep 07). PR Newswire Retrieved from http://search.proquest.com.ezp-prod1.hul.harvard.edu/docview/1817414493?accountid=11311
 Ross, C. and Swetlitz, I. (2017). IBM pitched Watson as a revolution in cancer care. It’s nowhere close. [online] STAT. Available at: https://www.statnews.com/2017/09/05/watson-ibm-cancer/ [Accessed 11 Nov. 2018].
 GE and partners HealthCare launch AI initiative. (2017, Jun 19). M2 Presswire Retrieved from http://search.proquest.com.ezp-prod1.hul.harvard.edu/docview/1918988908?accountid=11311
 Understanding and Confronting Our Mistakes: The Epidemiology of Error in Radiology and Strategies for Error Reduction. Michael A. Bruno, Eric A. Walker, and Hani H. Abujudeh. RadioGraphics 2015 35:6, 1668-1676
[Image] Monegain, Bernie. “IBM Watson, Quest Diagnostics, Memorial Sloan Kettering Cancer Center, MIT, Harvard Combine Forces for Massive Oncology, Precision Medicine Initiative.” Healthcare IT News. 2016. Accessed 2018. https://www.healthcareitnews.com/news/ibm-watson-quest-diagnostics-memorial-sloan-kettering-cancer-center-mit-harvard-combine-forces.