BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
of Korea University
Task 1
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
Binding 347 ( 40) 90 ( 40) 11.53 44.44 18.31
Gene_expression 722 ( 147) 218 ( 147) 20.36 67.43 31.28
Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
Protein_catabolism 14 ( 1) 3 ( 1) 7.14 33.33 11.76
Phosphorylation 135 ( 40) 59 ( 40) 29.63 67.80 41.24
==[EVT-TOTAL]== 1529 ( 275) 456 ( 275) 17.99 60.31 27.71
------------------------------------------------------------------------------------
Regulation 291 ( 2) 12 ( 2) 0.69 16.67 1.32
Positive_regulation 983 ( 7) 14 ( 7) 0.71 50.00 1.40
Negative_regulation 379 ( 2) 3 ( 2) 0.53 66.67 1.05
==[REG-TOTAL]== 1653 ( 11) 29 ( 11) 0.67 37.93 1.31
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3182 ( 286) 485 ( 286) 8.99 58.97 15.60
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
Binding 347 ( 45) 90 ( 45) 12.97 50.00 20.59
Gene_expression 722 ( 151) 218 ( 151) 20.91 69.27 32.13
Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
Protein_catabolism 14 ( 1) 3 ( 1) 7.14 33.33 11.76
Phosphorylation 135 ( 44) 59 ( 44) 32.59 74.58 45.36
==[EVT-TOTAL]== 1529 ( 288) 456 ( 288) 18.84 63.16 29.02
------------------------------------------------------------------------------------
Regulation 291 ( 2) 12 ( 2) 0.69 16.67 1.32
Positive_regulation 983 ( 7) 14 ( 7) 0.71 50.00 1.40
Negative_regulation 379 ( 2) 3 ( 2) 0.53 66.67 1.05
==[REG-TOTAL]== 1653 ( 11) 29 ( 11) 0.67 37.93 1.31
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3182 ( 299) 485 ( 299) 9.40 61.65 16.31
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
Binding 347 ( 45) 90 ( 45) 12.97 50.00 20.59
Gene_expression 722 ( 151) 218 ( 151) 20.91 69.27 32.13
Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
Protein_catabolism 14 ( 1) 3 ( 1) 7.14 33.33 11.76
Phosphorylation 135 ( 44) 59 ( 44) 32.59 74.58 45.36
==[EVT-TOTAL]== 1529 ( 288) 456 ( 288) 18.84 63.16 29.02
------------------------------------------------------------------------------------
Regulation 291 ( 2) 12 ( 2) 0.69 16.67 1.32
Positive_regulation 983 ( 7) 14 ( 7) 0.71 50.00 1.40
Negative_regulation 379 ( 2) 3 ( 2) 0.53 66.67 1.05
==[REG-TOTAL]== 1653 ( 11) 29 ( 11) 0.67 37.93 1.31
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3182 ( 299) 485 ( 299) 9.40 61.65 16.31
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
Binding 398 ( 68) 101 ( 68) 17.09 67.33 27.25
Gene_expression 722 ( 147) 218 ( 147) 20.36 67.43 31.28
Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
Protein_catabolism 14 ( 1) 3 ( 1) 7.14 33.33 11.76
Phosphorylation 135 ( 40) 59 ( 40) 29.63 67.80 41.24
==[EVT-TOTAL]== 1580 ( 303) 467 ( 303) 19.18 64.88 29.60
------------------------------------------------------------------------------------
Regulation 338 ( 2) 12 ( 2) 0.59 16.67 1.14
Positive_regulation 1186 ( 8) 17 ( 8) 0.67 47.06 1.33
Negative_regulation 416 ( 2) 3 ( 2) 0.48 66.67 0.95
==[REG-TOTAL]== 1940 ( 12) 32 ( 12) 0.62 37.50 1.22
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3520 ( 315) 499 ( 315) 8.95 63.13 15.68
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Localization 174 ( 35) 43 ( 35) 20.11 81.40 32.26
Binding 398 ( 76) 101 ( 76) 19.10 75.25 30.46
Gene_expression 722 ( 151) 218 ( 151) 20.91 69.27 32.13
Transcription 137 ( 12) 43 ( 12) 8.76 27.91 13.33
Protein_catabolism 14 ( 1) 3 ( 1) 7.14 33.33 11.76
Phosphorylation 135 ( 44) 59 ( 44) 32.59 74.58 45.36
==[EVT-TOTAL]== 1580 ( 319) 467 ( 319) 20.19 68.31 31.17
------------------------------------------------------------------------------------
Regulation 338 ( 2) 12 ( 2) 0.59 16.67 1.14
Positive_regulation 1186 ( 9) 17 ( 9) 0.76 52.94 1.50
Negative_regulation 416 ( 2) 3 ( 2) 0.48 66.67 0.95
==[REG-TOTAL]== 1940 ( 13) 32 ( 13) 0.67 40.62 1.32
------------------------------------------------------------------------------------
==[ALL-TOTAL]== 3520 ( 332) 499 ( 332) 9.43 66.53 16.52
------------------------------------------------------------------------------------
Task 2
N/A
N/A
N/A
N/A
N/A
Task 3
N/A
N/A
N/A
N/A
N/A