BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Phosphorylation events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[JULIELab ] Phosphorylation 135 ( 97) 113 ( 97) 71.85 85.84 78.23
[ConcordU ] Phosphorylation 135 ( 91) 98 ( 91) 67.41 92.86 78.11
[UT+DBCLS ] Phosphorylation 135 ( 103) 137 ( 103) 76.30 75.18 75.74
[ UTurku ] Phosphorylation 135 ( 103) 146 ( 103) 76.30 70.55 73.31
[ UZurich ] Phosphorylation 135 ( 78) 84 ( 78) 57.78 92.86 71.23
[VIBGhent ] Phosphorylation 135 ( 74) 85 ( 74) 54.81 87.06 67.27
[ UNSW ] Phosphorylation 135 ( 82) 119 ( 82) 60.74 68.91 64.57
[ASU+HU+BU] Phosphorylation 135 ( 71) 88 ( 71) 52.59 80.68 63.68
[ UMich ] Phosphorylation 135 ( 95) 166 ( 95) 70.37 57.23 63.12
[ UNIMAN ] Phosphorylation 135 ( 103) 197 ( 103) 76.30 52.28 62.05
[ SCAI ] Phosphorylation 135 ( 66) 80 ( 66) 48.89 82.50 61.40
[CNBMadrid] Phosphorylation 135 ( 79) 123 ( 79) 58.52 64.23 61.24
[ Cam ] Phosphorylation 135 ( 64) 86 ( 64) 47.41 74.42 57.92
[CIPS-ASU ] Phosphorylation 135 ( 68) 107 ( 68) 50.37 63.55 56.20
[ UTokyo ] Phosphorylation 135 ( 58) 73 ( 58) 42.96 79.45 55.77
[ UAveiro ] Phosphorylation 135 ( 57) 84 ( 57) 42.22 67.86 52.05
[ USzeged ] Phosphorylation 135 ( 106) 274 ( 106) 78.52 38.69 51.83
[ NICTA ] Phosphorylation 135 ( 59) 95 ( 59) 43.70 62.11 51.30
[ Team 24 ] Phosphorylation 135 ( 59) 95 ( 59) 43.70 62.11 51.30
[ PIKB ] Phosphorylation 135 ( 46) 53 ( 46) 34.07 86.79 48.94
[ KoreaU ] Phosphorylation 135 ( 40) 59 ( 40) 29.63 67.80 41.24
[UAntwerp ] Phosphorylation 135 ( 37) 56 ( 37) 27.41 66.07 38.74
[CCP-BTMG ] Phosphorylation 135 ( 30) 30 ( 30) 22.22 100.00 36.36
[ Team 09 ] Phosphorylation 135 ( 15) 20 ( 15) 11.11 75.00 19.35
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Phosphorylation 139 ( 93) 137 ( 93) 66.91 67.88 67.39
[CNBMadrid] Phosphorylation 139 ( 65) 123 ( 65) 46.76 52.85 49.62
[ Team 24 ] Phosphorylation 139 ( 54) 119 ( 54) 38.85 45.38 41.86
[CCP-BTMG ] Phosphorylation 139 ( 28) 30 ( 28) 20.14 93.33 33.14
[ASU+HU+BU] Phosphorylation 139 ( 28) 88 ( 28) 20.14 31.82 24.67
[UAntwerp ] Phosphorylation 139 ( 21) 56 ( 21) 15.11 37.50 21.54
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------