BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Binding events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Binding 347 ( 120) 279 ( 120) 34.58 43.01 38.34
[VIBGhent ] Binding 347 ( 129) 342 ( 129) 37.18 37.72 37.45
[ UTokyo ] Binding 347 ( 112) 253 ( 112) 32.28 44.27 37.33
[JULIELab ] Binding 347 ( 135) 489 ( 135) 38.90 27.61 32.30
[ UZurich ] Binding 347 ( 102) 287 ( 102) 29.39 35.54 32.18
[UT+DBCLS ] Binding 347 ( 74) 166 ( 74) 21.33 44.58 28.85
[ UNSW ] Binding 347 ( 79) 220 ( 79) 22.77 35.91 27.87
[ SCAI ] Binding 347 ( 85) 284 ( 85) 24.50 29.93 26.94
[ConcordU ] Binding 347 ( 68) 175 ( 68) 19.60 38.86 26.05
[ Team 24 ] Binding 347 ( 67) 223 ( 67) 19.31 30.04 23.51
[CNBMadrid] Binding 347 ( 101) 560 ( 101) 29.11 18.04 22.27
[ASU+HU+BU] Binding 347 ( 55) 156 ( 55) 15.85 35.26 21.87
[CIPS-ASU ] Binding 347 ( 58) 190 ( 58) 16.71 30.53 21.60
[ NICTA ] Binding 347 ( 55) 200 ( 55) 15.85 27.50 20.11
[CCP-BTMG ] Binding 347 ( 44) 110 ( 44) 12.68 40.00 19.26
[ USzeged ] Binding 347 ( 53) 206 ( 53) 15.27 25.73 19.17
[ KoreaU ] Binding 347 ( 40) 90 ( 40) 11.53 44.44 18.31
[ UNIMAN ] Binding 347 ( 39) 109 ( 39) 11.24 35.78 17.11
[UAntwerp ] Binding 347 ( 42) 145 ( 42) 12.10 28.97 17.07
[ Cam ] Binding 347 ( 41) 138 ( 41) 11.82 29.71 16.91
[ UAveiro ] Binding 347 ( 38) 138 ( 38) 10.95 27.54 15.67
[ UMich ] Binding 347 ( 90) 879 ( 90) 25.94 10.24 14.68
[ PIKB ] Binding 347 ( 25) 63 ( 25) 7.20 39.68 12.20
[ Team 09 ] Binding 347 ( 9) 112 ( 9) 2.59 8.04 3.92
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Binding 349 ( 72) 166 ( 72) 20.63 43.37 27.96
[ Team 24 ] Binding 349 ( 64) 228 ( 64) 18.34 28.07 22.18
[ASU+HU+BU] Binding 349 ( 55) 156 ( 55) 15.76 35.26 21.78
[CCP-BTMG ] Binding 349 ( 43) 110 ( 43) 12.32 39.09 18.74
[UAntwerp ] Binding 349 ( 38) 145 ( 38) 10.89 26.21 15.38
[CNBMadrid] Binding 349 ( 59) 560 ( 59) 16.91 10.54 12.98
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------