BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home]
[Evaluation Methods]
[Master Result Table]
[Team Profiles]
[System Profiles]
Final Evaluation Results
on EVT-TOTAL events by Strict matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[EVT-TOTAL]== 1529 ( 859) 1259 ( 859) 56.18 68.23 61.62
[VIBGhent ] ==[EVT-TOTAL]== 1529 ( 759) 1157 ( 759) 49.64 65.60 56.52
[UT+DBCLS ] ==[EVT-TOTAL]== 1529 ( 713) 1072 ( 713) 46.63 66.51 54.83
[JULIELab ] ==[EVT-TOTAL]== 1529 ( 775) 1375 ( 775) 50.69 56.36 53.37
[ConcordU ] ==[EVT-TOTAL]== 1529 ( 642) 897 ( 642) 41.99 71.57 52.93
[ UTokyo ] ==[EVT-TOTAL]== 1529 ( 633) 1012 ( 633) 41.40 62.55 49.82
[ASU+HU+BU] ==[EVT-TOTAL]== 1529 ( 578) 850 ( 578) 37.80 68.00 48.59
[ UNIMAN ] ==[EVT-TOTAL]== 1529 ( 617) 1044 ( 617) 40.35 59.10 47.96
[ UZurich ] ==[EVT-TOTAL]== 1529 ( 617) 1084 ( 617) 40.35 56.92 47.23
[ UNSW ] ==[EVT-TOTAL]== 1529 ( 574) 995 ( 574) 37.54 57.69 45.48
[ SCAI ] ==[EVT-TOTAL]== 1529 ( 558) 1015 ( 558) 36.49 54.98 43.87
[ Cam ] ==[EVT-TOTAL]== 1529 ( 494) 744 ( 494) 32.31 66.40 43.47
[ Team 24 ] ==[EVT-TOTAL]== 1529 ( 544) 977 ( 544) 35.58 55.68 43.42
[UAntwerp ] ==[EVT-TOTAL]== 1529 ( 519) 889 ( 519) 33.94 58.38 42.93
[ USzeged ] ==[EVT-TOTAL]== 1529 ( 604) 1473 ( 604) 39.50 41.00 40.24
[ UAveiro ] ==[EVT-TOTAL]== 1529 ( 477) 858 ( 477) 31.20 55.59 39.97
[CNBMadrid] ==[EVT-TOTAL]== 1529 ( 637) 1837 ( 637) 41.66 34.68 37.85
[ NICTA ] ==[EVT-TOTAL]== 1529 ( 415) 677 ( 415) 27.14 61.30 37.62
[CCP-BTMG ] ==[EVT-TOTAL]== 1529 ( 364) 490 ( 364) 23.81 74.29 36.06
[CIPS-ASU ] ==[EVT-TOTAL]== 1529 ( 515) 1406 ( 515) 33.68 36.63 35.09
[ PIKB ] ==[EVT-TOTAL]== 1529 ( 329) 479 ( 329) 21.52 68.68 32.77
[ KoreaU ] ==[EVT-TOTAL]== 1529 ( 275) 456 ( 275) 17.99 60.31 27.71
[ UMich ] ==[EVT-TOTAL]== 1529 ( 660) 3303 ( 660) 43.17 19.98 27.32
[ Team 09 ] ==[EVT-TOTAL]== 1529 ( 329) 885 ( 329) 21.52 37.18 27.26
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[EVT-TOTAL]== 1535 ( 692) 1072 ( 692) 45.08 64.55 53.09
[ASU+HU+BU] ==[EVT-TOTAL]== 1535 ( 520) 850 ( 520) 33.88 61.18 43.61
[ Team 24 ] ==[EVT-TOTAL]== 1535 ( 527) 1021 ( 527) 34.33 51.62 41.24
[UAntwerp ] ==[EVT-TOTAL]== 1535 ( 494) 889 ( 494) 32.18 55.57 40.76
[CCP-BTMG ] ==[EVT-TOTAL]== 1535 ( 360) 490 ( 360) 23.45 73.47 35.56
[CNBMadrid] ==[EVT-TOTAL]== 1535 ( 569) 1837 ( 569) 37.07 30.97 33.75
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------