BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Regulation events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] Regulation 291 ( 63) 153 ( 63) 21.65 41.18 28.38
[UT+DBCLS ] Regulation 291 ( 65) 169 ( 65) 22.34 38.46 28.26
[ UTurku ] Regulation 291 ( 67) 194 ( 67) 23.02 34.54 27.63
[JULIELab ] Regulation 291 ( 72) 302 ( 72) 24.74 23.84 24.28
[ UTokyo ] Regulation 291 ( 31) 81 ( 31) 10.65 38.27 16.67
[ UNSW ] Regulation 291 ( 32) 161 ( 32) 11.00 19.88 14.16
[ UZurich ] Regulation 291 ( 29) 120 ( 29) 9.97 24.17 14.11
[ Cam ] Regulation 291 ( 24) 74 ( 24) 8.25 32.43 13.15
[VIBGhent ] Regulation 291 ( 28) 136 ( 28) 9.62 20.59 13.11
[ NICTA ] Regulation 291 ( 37) 339 ( 37) 12.71 10.91 11.75
[UAntwerp ] Regulation 291 ( 23) 110 ( 23) 7.90 20.91 11.47
[ Team 24 ] Regulation 291 ( 21) 92 ( 21) 7.22 22.83 10.97
[ UAveiro ] Regulation 291 ( 20) 165 ( 20) 6.87 12.12 8.77
[ SCAI ] Regulation 291 ( 25) 280 ( 25) 8.59 8.93 8.76
[CIPS-ASU ] Regulation 291 ( 27) 521 ( 27) 9.28 5.18 6.65
[CNBMadrid] Regulation 291 ( 27) 555 ( 27) 9.28 4.86 6.38
[ USzeged ] Regulation 291 ( 11) 65 ( 11) 3.78 16.92 6.18
[CCP-BTMG ] Regulation 291 ( 9) 19 ( 9) 3.09 47.37 5.81
[ UNIMAN ] Regulation 291 ( 9) 47 ( 9) 3.09 19.15 5.33
[ PIKB ] Regulation 291 ( 4) 15 ( 4) 1.37 26.67 2.61
[ UMich ] Regulation 291 ( 6) 236 ( 6) 2.06 2.54 2.28
[ KoreaU ] Regulation 291 ( 2) 12 ( 2) 0.69 16.67 1.32
[ASU+HU+BU] Regulation 291 ( 1) 13 ( 1) 0.34 7.69 0.66
[ Team 09 ] Regulation 291 ( 0) 0 ( 0) 0.00 0.00 0.00
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Regulation 292 ( 62) 169 ( 62) 21.23 36.69 26.90
[UAntwerp ] Regulation 292 ( 22) 110 ( 22) 7.53 20.00 10.95
[ Team 24 ] Regulation 292 ( 21) 94 ( 21) 7.19 22.34 10.88
[CCP-BTMG ] Regulation 292 ( 9) 19 ( 9) 3.08 47.37 5.79
[CNBMadrid] Regulation 292 ( 22) 555 ( 22) 7.53 3.96 5.19
[ASU+HU+BU] Regulation 292 ( 1) 13 ( 1) 0.34 7.69 0.66
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------