BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Localization events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Localization 174 ( 85) 105 ( 85) 48.85 80.95 60.93
[VIBGhent ] Localization 174 ( 75) 98 ( 75) 43.10 76.53 55.15
[JULIELab ] Localization 174 ( 73) 98 ( 73) 41.95 74.49 53.68
[UT+DBCLS ] Localization 174 ( 65) 75 ( 65) 37.36 86.67 52.21
[ConcordU ] Localization 174 ( 61) 67 ( 61) 35.06 91.04 50.62
[ UNIMAN ] Localization 174 ( 77) 147 ( 77) 44.25 52.38 47.98
[ASU+HU+BU] Localization 174 ( 57) 70 ( 57) 32.76 81.43 46.72
[ UTokyo ] Localization 174 ( 54) 59 ( 54) 31.03 91.53 46.35
[ UAveiro ] Localization 174 ( 56) 89 ( 56) 32.18 62.92 42.59
[CNBMadrid] Localization 174 ( 60) 114 ( 60) 34.48 52.63 41.67
[ UMich ] Localization 174 ( 77) 212 ( 77) 44.25 36.32 39.90
[ SCAI ] Localization 174 ( 46) 58 ( 46) 26.44 79.31 39.66
[ Cam ] Localization 174 ( 44) 50 ( 44) 25.29 88.00 39.29
[ Team 24 ] Localization 174 ( 47) 80 ( 47) 27.01 58.75 37.01
[ UNSW ] Localization 174 ( 39) 41 ( 39) 22.41 95.12 36.28
[ NICTA ] Localization 174 ( 41) 66 ( 41) 23.56 62.12 34.17
[ KoreaU ] Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
[UAntwerp ] Localization 174 ( 35) 46 ( 35) 20.11 76.09 31.82
[CIPS-ASU ] Localization 174 ( 48) 143 ( 48) 27.59 33.57 30.28
[ UZurich ] Localization 174 ( 31) 34 ( 31) 17.82 91.18 29.81
[ PIKB ] Localization 174 ( 19) 23 ( 19) 10.92 82.61 19.29
[CCP-BTMG ] Localization 174 ( 18) 18 ( 18) 10.34 100.00 18.75
[ USzeged ] Localization 174 ( 13) 33 ( 13) 7.47 39.39 12.56
[ Team 09 ] Localization 174 ( 1) 1 ( 1) 0.57 100.00 1.14
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Localization 174 ( 56) 75 ( 56) 32.18 74.67 44.98
[ASU+HU+BU] Localization 174 ( 42) 70 ( 42) 24.14 60.00 34.43
[CNBMadrid] Localization 174 ( 48) 114 ( 48) 27.59 42.11 33.33
[ Team 24 ] Localization 174 ( 38) 95 ( 38) 21.84 40.00 28.25
[UAntwerp ] Localization 174 ( 30) 46 ( 30) 17.24 65.22 27.27
[CCP-BTMG ] Localization 174 ( 17) 18 ( 17) 9.77 94.44 17.71
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------