Annotator | Dataset | Micro F1 score | Micro Precision | Micro Recall | Macro F1 score | Macro Precision | Macro Recall | InKB Macro F1 score | InKB Macro Precision | InKB Macro Recall | InKB Micro F1 score | InKB Micro Precision | InKB Micro Recall | EE Macro F1 score | EE Macro Precision | EE Macro Recall | EE Micro F1 score | EE Micro Precision | EE Micro Recall | avg millis/doc | confidence threshold | GSInKB Macro F1 score | GSInKB Macro Precision | GSInKB Macro Recall | GSInKB Micro F1 score | GSInKB Micro Precision | Error Count | Timestamp | GERBIL version |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
NERFGUN (NIF WS) | ACE2004 | 0.7353 | 0.7353 | 0.7353 | 0.8326 | 0.8326 | 0.8326 | 0.8529 | 0.8422 | 0.8755 | 0.781 | 0.753 | 0.8112 | 0.7148 | 0.7469 | 0.7044 | 0.5625 | 0.6545 | 0.4932 | 1,197.2281 | 0 | 0.8755 | 0.8755 | 0.8755 | 0.8112 | 0.8112 | 0 | 2016-04-29 19:33:09 | 1.2.2 |
NERFGUN (NIF WS) | AIDA/CoNLL-Complete | 0.6464 | 0.6464 | 0.6464 | 0.6505 | 0.6505 | 0.6505 | 0.6828 | 0.6072 | 0.8266 | 0.7014 | 0.6115 | 0.8223 | 0.4278 | 0.7127 | 0.3465 | 0.4392 | 0.985 | 0.2826 | 677.6152 | 0 | 0.8352 | 0.8352 | 0.8352 | 0.8223 | 0.8223 | 0 | 2016-04-29 20:43:24 | 1.2.2 |
NERFGUN (NIF WS) | AIDA/CoNLL-Test A | 0.6481 | 0.6481 | 0.6481 | 0.6341 | 0.6341 | 0.6341 | 0.6605 | 0.5926 | 0.7864 | 0.6999 | 0.6174 | 0.8078 | 0.4114 | 0.6751 | 0.3349 | 0.4334 | 0.9727 | 0.2788 | 1,435.5787 | 0 | 0.7864 | 0.7864 | 0.7864 | 0.8078 | 0.8078 | 0 | 2016-04-29 19:36:17 | 1.2.2 |
NERFGUN (NIF WS) | AIDA/CoNLL-Test B | 0.6159 | 0.6159 | 0.6159 | 0.6313 | 0.6313 | 0.6313 | 0.6635 | 0.5901 | 0.8023 | 0.6702 | 0.5773 | 0.7988 | 0.4182 | 0.6955 | 0.3388 | 0.4215 | 0.9942 | 0.2675 | 1,355.5758 | 0 | 0.8109 | 0.8109 | 0.8109 | 0.7988 | 0.7988 | 0 | 2016-04-29 19:36:11 | 1.2.2 |
NERFGUN (NIF WS) | AIDA/CoNLL-Training | 0.6584 | 0.6584 | 0.6584 | 0.6618 | 0.6618 | 0.6618 | 0.6955 | 0.6175 | 0.8447 | 0.7157 | 0.6238 | 0.8393 | 0.4339 | 0.7256 | 0.351 | 0.445 | 0.9857 | 0.2873 | 823.5782 | 0 | 0.8553 | 0.8553 | 0.8553 | 0.8393 | 0.8393 | 0 | 2016-04-29 20:42:01 | 1.2.2 |
NERFGUN (NIF WS) | AQUAINT | 0.7249 | 0.7249 | 0.7249 | 0.7187 | 0.7187 | 0.7187 | 0.7558 | 0.7538 | 0.7629 | 0.7623 | 0.7557 | 0.769 | 0.32 | 0.32 | 0.32 | 0.027 | 0.0323 | 0.0233 | 734.7 | 0 | 0.7629 | 0.7629 | 0.7629 | 0.769 | 0.769 | 0 | 2016-04-29 19:44:06 | 1.2.2 |
NERFGUN (NIF WS) | DBpediaSpotlight | 0.5273 | 0.5273 | 0.5273 | 0.5602 | 0.5602 | 0.5602 | 0.5856 | 0.6472 | 0.5602 | 0.6327 | 0.7909 | 0.5273 | 0.5345 | 0.5345 | 0.5345 | 0 | 0 | 0 | 578.569 | 0 | 0.5602 | 0.5602 | 0.5602 | 0.5273 | 0.5273 | 0 | 2016-04-29 19:36:35 | 1.2.2 |
NERFGUN (NIF WS) | IITB | 0.3654 | 0.4052 | 0.3327 | 0.3405 | 0.3405 | 0.3405 | 0.3567 | 0.3199 | 0.4548 | 0.4206 | 0.4023 | 0.4405 | 0.1157 | 0.236 | 0.1632 | 0.2397 | 0.4173 | 0.1682 | 8,665.764 | 0 | 0.4644 | 0.4644 | 0.4644 | 0.487 | 0.5443 | 15 | 2016-04-29 23:24:28 | 1.2.2 |
NERFGUN (NIF WS) | KORE50 | 0.4375 | 0.4375 | 0.4375 | 0.398 | 0.398 | 0.398 | 0.3993 | 0.4013 | 0.398 | 0.4406 | 0.4437 | 0.4375 | 0.96 | 0.96 | 0.96 | 0 | 0 | 0 | 1,370.68 | 0 | 0.398 | 0.398 | 0.398 | 0.4375 | 0.4375 | 0 | 2016-04-29 19:34:17 | 1.2.2 |
NERFGUN (NIF WS) | MSNBC | The annotator caused too many single errors. | 2016-04-29 19:31:06 | 1.2.2 | |||||||||||||||||||||||||
NERFGUN (NIF WS) | Microposts2014-Test | 0.6545 | 0.6545 | 0.6545 | 0.7791 | 0.7791 | 0.7791 | 0.7867 | 0.7994 | 0.7791 | 0.6879 | 0.7253 | 0.6542 | 0.8957 | 0.8957 | 0.8957 | 0.016 | 0.0081 | 1 | 618.2948 | 0 | 0.7791 | 0.7791 | 0.7791 | 0.6542 | 0.6542 | 0 | 2016-04-29 19:45:27 | 1.2.2 |
NERFGUN (NIF WS) | Microposts2014-Train | 0.6546 | 0.6546 | 0.6546 | 0.7581 | 0.7581 | 0.7581 | 0.7711 | 0.794 | 0.7582 | 0.6935 | 0.7375 | 0.6544 | 0.8574 | 0.8573 | 0.8577 | 0.0182 | 0.0092 | 0.8 | 30.2739 | 0 | 0.7582 | 0.7582 | 0.7582 | 0.6544 | 0.6544 | 0 | 2016-04-29 20:31:15 | 1.2.2 |
NERFGUN (NIF WS) | N3-RSS-500 | 0.6537 | 0.6543 | 0.653 | 0.653 | 0.653 | 0.653 | 0.563 | 0.556 | 0.587 | 0.5683 | 0.5099 | 0.6418 | 0.7607 | 0.799 | 0.745 | 0.7766 | 0.9326 | 0.6653 | 1,063.1804 | 0 | 0.741 | 0.741 | 0.741 | 0.6418 | 0.6418 | 1 | 2016-04-29 19:44:38 | 1.2.2 |
NERFGUN (NIF WS) | N3-Reuters-128 | 0.583 | 0.583 | 0.583 | 0.5793 | 0.5793 | 0.5793 | 0.5411 | 0.5865 | 0.5303 | 0.5688 | 0.5965 | 0.5436 | 0.5161 | 0.5309 | 0.5591 | 0.6137 | 0.5574 | 0.6827 | 995.3125 | 0 | 0.5693 | 0.5693 | 0.5693 | 0.5436 | 0.5436 | 0 | 2016-04-29 19:38:31 | 1.2.2 |