caa a22 4500 528794558 20201130031323.0 cr unu---uuuuu 180925e20180912xx s 000 0 eng (BORIS)oai:boris.unibe.ch:120088 610 ddc Objective Evaluation of Multiple Sclerosis Lesion Segmentation using a Data Management and Processing Infrastructure [Elektronische Daten] [Olivier Commowick, Audrey Istace, Michaël Kain, Baptiste Laurent, Florent Leray, Mathieu Simon, Sorina Camarasu Pop, Pascal Girard, Roxana Améli, Jean-Christophe Ferré, Anne Kerbrat, Thomas Tourdias, Frédéric Cervenansky, Tristan Glatard, Jérémy Beaumont, Senan Doyle, Florence Forbes, Jesse Knight, April Khademi, Amirreza Mahbod, Chunliang Wang, Richard McKinley, Franca Wagner, John Muschelli, Elizabeth Sweeney, Eloy Roura, Xavier Lladó, Michel M Santos, Wellington P Santos, Abel G Silva-Filho, Xavier Tomas-Fernandez, Hélène Urien, Isabelle Bloch, Sergi Valverde, Mariano Cabezas, Francisco Javier Vera-Olmos, Norberto Malpica, Charles Guttmann, Sandra Vukusic, Gilles Edan, Michel Dojat, Martin Styner, Simon K Warfield, François Cotton, Christian Barillot] publishedVersion openAccess eu-repo We present a study of multiple sclerosis segmentation algorithms conducted at the international MICCAI 2016 challenge. This challenge was operated using a new open-science computing infrastructure. This allowed for the automatic and independent evaluation of a large range of algorithms in a fair and completely automatic manner. This computing infrastructure was used to evaluate thirteen methods of MS lesions segmentation, exploring a broad range of state-of-theart algorithms, against a high-quality database of 53 MS cases coming from four centers following a common definition of the acquisition protocol. Each case was annotated manually by an unprecedented number of seven different experts. Results of the challenge highlighted that automatic algorithms, including the recent machine learning methods (random forests, deep learning, ...), are still trailing human expertise on both detection and delineation criteria. In addition, we demonstrate that computing a statistically robust consensus of the algorithms performs closer to human expertise on one score (segmentation) although still trailing on detection scores. Commowick Olivier joint author Istace Audrey joint author Kain Michaël joint author Laurent Baptiste joint author Leray Florent joint author Simon Mathieu joint author Pop Sorina Camarasu joint author Girard Pascal joint author Améli Roxana joint author Ferré Jean-Christophe joint author Kerbrat Anne joint author Tourdias Thomas joint author Cervenansky Frédéric joint author Glatard Tristan joint author Beaumont Jérémy joint author Doyle Senan joint author Forbes Florence joint author Knight Jesse joint author Khademi April joint author Mahbod Amirreza joint author Wang Chunliang joint author McKinley Richard joint author Wagner Franca joint author Muschelli John joint author Sweeney Elizabeth joint author Roura Eloy joint author Lladó Xavier joint author Santos Michel M. joint author Santos Wellington P. joint author Silva-Filho Abel G. joint author Tomas-Fernandez Xavier joint author Urien Hélène joint author Bloch Isabelle joint author Valverde Sergi joint author Cabezas Mariano joint author Vera-Olmos Francisco Javier joint author Malpica Norberto joint author Guttmann Charles joint author Vukusic Sandra joint author Edan Gilles joint author Dojat Michel joint author Styner Martin joint author Warfield Simon K. joint author Cotton François joint author Barillot Christian joint author Scientific Reports 8(1), p. 13650 Onlinezugriff via WWW text/html Commowick, Olivier; Istace, Audrey; Kain, Michaël; Laurent, Baptiste; Leray, Florent; Simon, Mathieu; Pop, Sorina Camarasu; Girard, Pascal; Améli, Roxana; Ferré, Jean-Christophe; Kerbrat, Anne; Tourdias, Thomas; Cervenansky, Frédéric; Glatard, Tristan; Beaumont, Jérémy; Doyle, Senan; Forbes, Florence; Knight, Jesse; Khademi, April; Mahbod, Amirreza; ... (2018). Objective Evaluation of Multiple Sclerosis Lesion Segmentation using a Data Management and Processing Infrastructure. Scientific Reports, 8(1), p. 13650. Nature Publishing Group 10.1038/s41598-018-31911-7 <http://dx.doi.org/10.1038/s41598-018-31911-7> BORIS BK010053 XK010053 XK010000 1 info:eu-repo/semantics/article boris PeerReviewed boris peerstatus BORIS BORIS BORIS info:eu-repo/semantics/article openAccess BORIS 856 42 Onlinezugriff via WWW text/html Commowick, Olivier; Istace, Audrey; Kain, Michaël; Laurent, Baptiste; Leray, Florent; Simon, Mathieu; Pop, Sorina Camarasu; Girard, Pascal; Améli, Roxana; Ferré, Jean-Christophe; Kerbrat, Anne; Tourdias, Thomas; Cervenansky, Frédéric; Glatard, Tristan; Beaumont, Jérémy; Doyle, Senan; Forbes, Florence; Knight, Jesse; Khademi, April; Mahbod, Amirreza; ... (2018). Objective Evaluation of Multiple Sclerosis Lesion Segmentation using a Data Management and Processing Infrastructure. Scientific Reports, 8(1), p. 13650. Nature Publishing Group 10.1038/s41598-018-31911-7 <http://dx.doi.org/10.1038/s41598-018-31911-7> BORIS 700 1- Commowick Olivier joint author BORIS 700 1- Istace Audrey joint author BORIS 700 1- Kain Michaël joint author BORIS 700 1- Laurent Baptiste joint author BORIS 700 1- Leray Florent joint author BORIS 700 1- Simon Mathieu joint author BORIS 700 1- Pop Sorina Camarasu joint author BORIS 700 1- Girard Pascal joint author BORIS 700 1- Améli Roxana joint author BORIS 700 1- Ferré Jean-Christophe joint author BORIS 700 1- Kerbrat Anne joint author BORIS 700 1- Tourdias Thomas joint author BORIS 700 1- Cervenansky Frédéric joint author BORIS 700 1- Glatard Tristan joint author BORIS 700 1- Beaumont Jérémy joint author BORIS 700 1- Doyle Senan joint author BORIS 700 1- Forbes Florence joint author BORIS 700 1- Knight Jesse joint author BORIS 700 1- Khademi April joint author BORIS 700 1- Mahbod Amirreza joint author BORIS 700 1- Wang Chunliang joint author BORIS 700 1- McKinley Richard joint author BORIS 700 1- Wagner Franca joint author BORIS 700 1- Muschelli John joint author BORIS 700 1- Sweeney Elizabeth joint author BORIS 700 1- Roura Eloy joint author BORIS 700 1- Lladó Xavier joint author BORIS 700 1- Santos Michel M. joint author BORIS 700 1- Santos Wellington P. joint author BORIS 700 1- Silva-Filho Abel G. joint author BORIS 700 1- Tomas-Fernandez Xavier joint author BORIS 700 1- Urien Hélène joint author BORIS 700 1- Bloch Isabelle joint author BORIS 700 1- Valverde Sergi joint author BORIS 700 1- Cabezas Mariano joint author BORIS 700 1- Vera-Olmos Francisco Javier joint author BORIS 700 1- Malpica Norberto joint author BORIS 700 1- Guttmann Charles joint author BORIS 700 1- Vukusic Sandra joint author BORIS 700 1- Edan Gilles joint author BORIS 700 1- Dojat Michel joint author BORIS 700 1- Styner Martin joint author BORIS 700 1- Warfield Simon K. joint author BORIS 700 1- Cotton François joint author BORIS 700 1- Barillot Christian joint author BORIS 773 0- Scientific Reports 8(1), p. 13650