BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
of University of Zurich
Task 1
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 31) 34 ( 31) 17.82 91.18 29.81
Binding 347 ( 102) 287 ( 102) 29.39 35.54 32.18
Gene_expression 722 ( 370) 515 ( 370) 51.25 71.84 59.82
Transcription 137 ( 28) 148 ( 28) 20.44 18.92 19.65
Protein_catabolism 14 ( 8) 16 ( 8) 57.14 50.00 53.33
Phosphorylation 135 ( 78) 84 ( 78) 57.78 92.86 71.23
==[EVT-TOTAL]== 1529 ( 617) 1084 ( 617) 40.35 56.92 47.23
------------------------------------------------------------------------------------
Regulation 291 ( 29) 120 ( 29) 9.97 24.17 14.11
Positive_regulation 983 ( 138) 533 ( 138) 14.04 25.89 18.21
Negative_regulation 379 ( 55) 158 ( 55) 14.51 34.81 20.48
==[REG-TOTAL]== 1653 ( 222) 811 ( 222) 13.43 27.37 18.02
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3182 ( 839) 1895 ( 839) 26.37 44.27 33.05
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 32) 34 ( 32) 18.39 94.12 30.77
Binding 347 ( 107) 287 ( 107) 30.84 37.28 33.75
Gene_expression 722 ( 379) 515 ( 379) 52.49 73.59 61.28
Transcription 137 ( 31) 148 ( 31) 22.63 20.95 21.75
Protein_catabolism 14 ( 8) 16 ( 8) 57.14 50.00 53.33
Phosphorylation 135 ( 81) 84 ( 81) 60.00 96.43 73.97
==[EVT-TOTAL]== 1529 ( 638) 1084 ( 638) 41.73 58.86 48.83
------------------------------------------------------------------------------------
Regulation 291 ( 34) 120 ( 34) 11.68 28.33 16.55
Positive_regulation 983 ( 148) 533 ( 148) 15.06 27.77 19.53
Negative_regulation 379 ( 56) 158 ( 56) 14.78 35.44 20.86
==[REG-TOTAL]== 1653 ( 238) 811 ( 238) 14.40 29.35 19.32
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3182 ( 876) 1895 ( 876) 27.53 46.23 34.51
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 32) 34 ( 32) 18.39 94.12 30.77
Binding 347 ( 107) 287 ( 107) 30.84 37.28 33.75
Gene_expression 722 ( 379) 515 ( 379) 52.49 73.59 61.28
Transcription 137 ( 31) 148 ( 31) 22.63 20.95 21.75
Protein_catabolism 14 ( 8) 16 ( 8) 57.14 50.00 53.33
Phosphorylation 135 ( 81) 84 ( 81) 60.00 96.43 73.97
==[EVT-TOTAL]== 1529 ( 638) 1084 ( 638) 41.73 58.86 48.83
------------------------------------------------------------------------------------
Regulation 291 ( 34) 120 ( 34) 11.68 28.33 16.55
Positive_regulation 983 ( 152) 533 ( 152) 15.46 28.52 20.05
Negative_regulation 379 ( 59) 158 ( 59) 15.57 37.34 21.97
==[REG-TOTAL]== 1653 ( 245) 811 ( 245) 14.82 30.21 19.89
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3182 ( 883) 1895 ( 883) 27.75 46.60 34.78
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 31) 34 ( 31) 17.82 91.18 29.81
Binding 398 ( 140) 250 ( 140) 35.18 56.00 43.21
Gene_expression 722 ( 370) 515 ( 370) 51.25 71.84 59.82
Transcription 137 ( 28) 148 ( 28) 20.44 18.92 19.65
Protein_catabolism 14 ( 8) 16 ( 8) 57.14 50.00 53.33
Phosphorylation 135 ( 78) 84 ( 78) 57.78 92.86 71.23
==[EVT-TOTAL]== 1580 ( 655) 1047 ( 655) 41.46 62.56 49.87
------------------------------------------------------------------------------------
Regulation 338 ( 40) 121 ( 40) 11.83 33.06 17.43
Positive_regulation 1186 ( 218) 528 ( 218) 18.38 41.29 25.44
Negative_regulation 416 ( 64) 157 ( 64) 15.38 40.76 22.34
==[REG-TOTAL]== 1940 ( 322) 806 ( 322) 16.60 39.95 23.45
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3520 ( 977) 1853 ( 977) 27.76 52.73 36.37
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 32) 34 ( 32) 18.39 94.12 30.77
Binding 398 ( 145) 250 ( 145) 36.43 58.00 44.75
Gene_expression 722 ( 379) 515 ( 379) 52.49 73.59 61.28
Transcription 137 ( 31) 148 ( 31) 22.63 20.95 21.75
Protein_catabolism 14 ( 8) 16 ( 8) 57.14 50.00 53.33
Phosphorylation 135 ( 81) 84 ( 81) 60.00 96.43 73.97
==[EVT-TOTAL]== 1580 ( 676) 1047 ( 676) 42.78 64.57 51.47
------------------------------------------------------------------------------------
Regulation 338 ( 48) 121 ( 48) 14.20 39.67 20.92
Positive_regulation 1186 ( 236) 527 ( 236) 19.90 44.78 27.55
Negative_regulation 416 ( 67) 157 ( 67) 16.11 42.68 23.39
==[REG-TOTAL]== 1940 ( 351) 805 ( 351) 18.09 43.60 25.57
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3520 ( 1027) 1852 ( 1027) 29.18 55.45 38.24
------------------------------------------------------------------------------------
Task 2
N/A
N/A
N/A
N/A
N/A
Task 3
N/A
N/A
N/A
N/A
N/A