lucene-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Krallinger <>
Subject Last CFP: Automated clinical coding (ICD10) shared task: CodiEsp track (eHealth CLEF2020
Date Tue, 21 Apr 2020 09:47:58 GMT
**** Call for Participation CodiEsp: Clinical Case Coding Task (eHealth
CLEF 2020) *** *

*CodiEsp (eHealth CLEF– Multilingual Information Extraction) Shared Task on
automatic assignment of ICD10 codes (procedures, diagnosis) track at CLEF

Plan TL Award for the CodiEsp Track

We are currently organizing a shared task on automated clinical coding
methods (CodiEsp) that will be part of the eHealth CLEF 2020.

Clinical coding is of critical importance to generate indicators related to
diagnoses in epidemiological studies (epidemiology/health trends) and
determine treatment effectiveness resulting in a direct impact in patient

The CodiEsp sub-tracks:

*1.CodiEsp Diagnosis Coding *sub-task* (CodiEsp-D)*: will require automatic
ICD10-CM [CIE10 Diagnóstico] code assignment to each clinical case document.

*2.CodiEsp Procedure Coding *sub-task* (CodiEsp-P):* will require automatic
ICD10-PCS [CIE10 Procedimiento] code assignment to each clinical case

*3.CodiEsp Explainable AI *exploratory sub-task* (CodiEsp-X).* Systems are
required to extract the evidence text supporting the predicted codes (both
ICD10-CM and ICD10-PCS).

*Task description*

Clinical coding essentially requires the transformation (or classification)
of medical texts into a structured or coded format using internationally
recognized class codes.

These codes describe a patient’s diagnosis or treatment. Clinical coding is
critical for standardizing electronic clinical records; enable aetiology
studies, monitor health trends, carry out epidemiology studies, clinical
and biomedical research, assist clinical decision-making or even

As part of the eHealth CLEF ( Multilingual
Information Extraction Shared Task we organize* CodiEsp: Clinical Case
Coding Task ( <>). *The
CodiEsp task will address the automatic extraction and assignment of
clinical coding (diagnosis and procedures) to clinical case documents in

To enable participation of researches around the world, in addition to the
basic data in Spanish, we will also publish versions of the training,
development, and test set *automatically translated into English*.

Participating systems will be asked to automatically assign ICD10 codes (or
CIE-10, in Spanish) to clinical case documents. Evaluation is done through
comparison to manually assigned ICD10 codes.

*Publications and workshop*

As in previous eHealth CLEF efforts, there will be an *evaluation workshop
allocated at CLEF 2020* where participating teams can present their systems
and results. Moreover, participating teams will be invited to submit their
system description papers for publication at the *CLEF 2020 Working Notes
proceedings*. For previous working notes see:

*CodiEsp awards*

There will we three awards for the top-scoring teams promoted by the
Spanish Plan for the Advancement of Language Technology (Plan TL) and the
Barcelona Supercomputing Center (BSC).


*Participation and useful info*


   1. CodiEsp web, info & detailed description:
   2. Registration for CodiEsp (Multilingual Information Extraction eHealth
   3. Datasets:
   4. Additional training resources:


*Main CodiEsp Track organizers*


   - *Martin Krallinger*, Barcelona Supercomputing Center.
   - *Antonio Miranda*, Barcelona Supercomputing Center.
   - *Aitor Gonzalez-Agirre*, Barcelona Supercomputing Center.
   - *Marta Villegas*, Barcelona Supercomputing Center.
   - *Jordi Armengol*, Barcelona Supercomputing Center.


*Important Dates*


Jan 13: Training and development set release
March 2: Test and background set release
May 3: End of evaluation
May 5: Results notified
May  24: Paper submission
Jun 28: Camera-ready paper submission
Sep 22-25: CLEF 2020 Conference (Thessaloniki, Greece)

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message