CEGS N-GRID Natural Language Processing (NLP) Challenge and Workshop

November 11, 2016 (All day)
Hilton Chicago
720 South Michigan Avenue
Chicago, ILL 60605
312-922-4400 (map)

The 2016 Centers of Excellence in Genomic Science (CEGS) Neuropsychiatric Genome-Scale and RDoC Individualized Domains (N-GRID) Challenge, a.k.a., RDoC for Psychiatry Challenge, aims to extract symptom severity from neuropsychiatric clinical records.  RDoC is a framework developed under the aegis of the National Institute of Mental Health (NIMH) that facilitates the study of human behaviour from normal to abnormal in various domains.  The "Challenge" goal is to classify symptom severity in a domain for a patient based on information included in initital psychiatric evaluations and as recorded as part of each individual's electronic health record.

This Challenge will be conducted on initial psychiatric evaluations (1 per patient) which have been fully de-identified and scored by clinical experts in a symptom domain.  The data for this task are derived from actual clinical records used as part of this project and will be released under a Rules of Conduct and Data Use Agreement.   

The evaluation for the various NLP tracks will be conducted using withheld test data.  Participating teams are asked to stop development as soon as the test data is downloaded.  Each team is allowed to upload up to to three system runs for each task, output from which will be submitted in the exact format of the ground truth annotations provided by organizers for scoring.

Participants are asked to submit a 500-word long abstract describing their methodologies.  Abstracts may also have a graphical summary of the proposed architecture.  This document should not exceed 2 pages, 1.5 line spacing, 12 font size.  The authors of either the top performing systems or particularly novel approaches will be invited to present or demonstrate their systems at the Workshop.  A special issue of an appropriate journal will be organized following the workshop so that the NLP community at large may benefit from this work.


Organizing Committee:

Ozlem Uzuner, co-chair, SUNY at Albany

Amber Stubbs, co-chair, Simmons College

Michele Filannino, co-chair, SUNY at Albany

Tianxi Cai, Harvard T.H. Chan School of Public Health

Susanne Churchill, Harvard Medical School

Isaac Kohane, Harvard Medical School

Thomas McCoy, MGH, Harvard Medical School

Roy Perlis, MGH, Harvard Medical School

Peter Szolovits, MIT

Uma Vaidyanathan, NIMH

Philip Wang, American Psychiatric Association


Additional information, Challenge milestones and DUAs available here.  NOTE: DATE MAY SHIFT SLIGHTLY