GERBIL Experiment

Your Experiments are completed

Experiment URI:
Type: D2KB
Matching: Ma - strong annotation match
Annotator Dataset Micro F1 score Micro Precision Micro Recall Macro F1 score Macro Precision Macro Recall InKB Macro F1 score InKB Macro Precision InKB Macro Recall InKB Micro F1 score InKB Micro Precision InKB Micro Recall EE Macro F1 score EE Macro Precision EE Macro Recall EE Micro F1 score EE Micro Precision EE Micro Recall avg millis/doc confidence threshold GSInKB Macro F1 score GSInKB Macro Precision GSInKB Macro Recall GSInKB Micro F1 score GSInKB Micro Precision Error Count Timestamp GERBIL version
AIDA ACE2004 0.7174 0.8049 0.6471 0.8288 0.8791 0.7927 0.8918 0.8967 0.8916 0.7936 0.8049 0.7826 0.614 0.614 0.614 0 0 0 36,733.2281 0 0.908 0.928 0.8916 0.8199 0.8609 0 2017-04-30 17:09:48 1.2.5
AIDA AIDA/CoNLL-Test A 0.6707 0.7223 0.626 0.6256 0.6858 0.5848 0.7141 0.6858 0.7594 0.7468 0.7223 0.7731 0 0 0 0 0 0 25,241.8194 0.088 0.7681 0.7781 0.7594 0.7865 0.8003 0 2017-04-30 18:08:18 1.2.5
AIDA AIDA/CoNLL-Test B 0.6876 0.7363 0.6449 0.6777 0.7403 0.6362 0.7778 0.7446 0.8266 0.7703 0.7363 0.8076 0.1818 0.1818 0.1818 0 0 0 24,158.3117 0 0.8314 0.8369 0.8266 0.8128 0.8182 0 2017-04-30 18:09:41 1.2.5
AIDA AQUAINT 0.5528 0.6069 0.5076 0.548 0.6026 0.5063 0.5636 0.6026 0.5348 0.5694 0.6069 0.5363 0 0 0 0 0 0 31,603.28 0.0841 0.5835 0.6498 0.5348 0.5866 0.6474 0 2017-04-30 17:00:13 1.2.5
AIDA DBpediaSpotlight 0.249 0.3478 0.1939 0.2139 0.269 0.1815 0.2139 0.269 0.1815 0.249 0.3478 0.1939 24,710.2264 0.1903 0.2139 0.269 0.1815 0.249 0.3478 5 2017-04-30 17:21:46 1.2.5
AIDA ERD2014 0.6522 0.9091 0.5085 0.8022 0.8132 0.7967 0.8022 0.8132 0.7967 0.6522 0.9091 0.5085 7,075.8295 0 0.8022 0.8132 0.7967 0.6522 0.9091 3 2017-04-30 16:42:18 1.2.5
AIDA IITB 0.1799 0.2494 0.1406 0.1914 0.2701 0.1502 0.265 0.2797 0.2596 0.2409 0.2494 0.2331 0 0 0 0 0 0 40,961.049 0.6298 0.3221 0.4365 0.2596 0.2942 0.399 2 2017-04-30 18:11:27 1.2.5
AIDA KORE50 0.6884 0.7197 0.6597 0.6293 0.6293 0.6293 0.632 0.6293 0.636 0.6909 0.7197 0.6643 0.98 0.98 0.98 0 0 0 33,293.7 0 0.636 0.636 0.636 0.6934 0.7252 0 2017-04-30 16:59:20 1.2.5
AIDA MSNBC 0.6896 0.8289 0.5904 0.6486 0.7471 0.5821 0.7033 0.7471 0.6679 0.7456 0.8289 0.6774 0 0 0 0 0 0 38,950.4444 0.1936 0.7188 0.7877 0.6679 0.7597 0.8647 2 2017-04-30 16:45:10 1.2.5
AIDA N3-RSS-500 0.4515 0.6392 0.349 0.3913 0.476 0.349 0.6293 0.644 0.631 0.6548 0.6392 0.6712 0 0 0 0 0 0 11,871.658 0.1552 0.7647 0.786 0.754 0.7227 0.7856 0 2017-04-30 18:11:17 1.2.5
AIDA N3-Reuters-128 0.4659 0.6557 0.3614 0.3822 0.5114 0.3265 0.5123 0.5896 0.4887 0.5699 0.6557 0.504 0 0 0 0 0 0 25,722.0156 0.1282 0.5744 0.6741 0.5277 0.5994 0.7395 0 2017-04-30 17:28:18 1.2.5
Babelfy ACE2004 0.5615 0.6402 0.5 0.7162 0.7587 0.687 0.7658 0.7756 0.761 0.6191 0.6387 0.6008 0.614 0.614 0.614 0 0 0 1,101.7018 0.1576 0.7769 0.7972 0.761 0.6373 0.6786 0 2017-04-30 16:35:57 1.2.5
Babelfy AIDA/CoNLL-Test A 0.6479 0.6865 0.6135 0.5861 0.6336 0.555 0.6639 0.6315 0.7126 0.7186 0.6858 0.7547 0.1489 0.1667 0.146 0.0228 0.9286 0.0115 773.912 0.0243 0.7155 0.7188 0.7126 0.7589 0.763 0 2017-04-30 16:40:18 1.2.5
Babelfy AIDA/CoNLL-Test B 0.6782 0.7257 0.6366 0.6175 0.6703 0.5811 0.7002 0.6744 0.7377 0.7576 0.7253 0.7929 0.1968 0.2251 0.1917 0.033 0.9048 0.0168 564.9307 0.143 0.7445 0.753 0.7377 0.8002 0.8076 0 2017-04-30 16:38:51 1.2.5
Babelfy AQUAINT 0.6821 0.7202 0.6479 0.6829 0.7217 0.6501 0.7028 0.7263 0.6871 0.7035 0.7235 0.6846 0.52 0.52 0.52 0 0 0 847.6 0.1815 0.7238 0.7678 0.6871 0.7229 0.7659 0 2017-04-30 16:34:35 1.2.5
Babelfy DBpediaSpotlight 0.5159 0.5768 0.4667 0.5092 0.5678 0.4717 0.5101 0.5703 0.4717 0.5176 0.5811 0.4667 0.9828 0.9828 0.9828 0 0 0 84.4655 0.25 0.5092 0.5678 0.4717 0.5159 0.5768 0 2017-04-30 17:00:01 1.2.5
Babelfy ERD2014 0.45 0.8571 0.3051 0.696 0.7143 0.6868 0.696 0.7143 0.6868 0.45 0.8571 0.3051 56.4505 0 0.696 0.7143 0.6868 0.45 0.8571 0 2017-04-30 16:32:00 1.2.5
Babelfy IITB 0.366 0.4442 0.3112 0.3507 0.4268 0.3006 0.4521 0.4275 0.4903 0.4762 0.4459 0.5109 0.0128 0.2269 0.0067 0.0137 0.311 0.007 1,315.3942 0.3639 0.5581 0.641 0.4999 0.5753 0.6582 0 2017-04-30 17:11:21 1.2.5
Babelfy KORE50 0.7384 0.763 0.7153 0.7008 0.7077 0.696 0.7048 0.7077 0.7027 0.741 0.763 0.7203 0 0 0 0 0 0 89.22 0.0412 0.6981 0.7077 0.6927 0.7365 0.7612 0 2017-04-30 16:31:40 1.2.5
Babelfy MSNBC 0.7092 0.7627 0.6627 0.6783 0.7368 0.6324 0.7273 0.7368 0.7246 0.7615 0.7627 0.7604 0 0 0 0 0 0 2,305.35 0.0788 0.7489 0.7768 0.7246 0.7814 0.8036 0 2017-04-30 16:34:16 1.2.5
Babelfy N3-RSS-500 0.4434 0.6338 0.341 0.381 0.461 0.341 0.628 0.643 0.63 0.6414 0.633 0.65 0.334 0.334 0.334 0.0083 0.6667 0.0042 202.5 0.25 0.7483 0.769 0.738 0.7042 0.7682 0 2017-04-30 16:34:02 1.2.5
Babelfy N3-Reuters-128 0.4529 0.6339 0.3523 0.3949 0.5313 0.3348 0.5458 0.6251 0.5148 0.5536 0.6339 0.4913 0 0 0 0 0 0 498.1484 0.2062 0.5869 0.6851 0.5375 0.5757 0.7016 0 2017-04-30 16:34:29 1.2.5
DBpedia Spotlight ACE2004 0.5405 0.8696 0.3922 0.716 0.8973 0.641 0.7761 0.9149 0.713 0.6138 0.8696 0.4743 0.614 0.614 0.614 0 0 0 83.6842 0 0.7788 0.9362 0.713 0.6218 0.9023 0 2017-04-30 16:34:59 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test A 0.4836 0.661 0.3813 0.474 0.6502 0.3891 0.5504 0.6502 0.5034 0.55 0.661 0.4709 0.1389 0.1389 0.1389 0 0 0 157.2546 0 0.578 0.727 0.5034 0.5727 0.7308 0 2017-04-30 16:37:40 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test B 0.5242 0.7145 0.414 0.5135 0.7006 0.4213 0.5986 0.705 0.5536 0.6009 0.7145 0.5184 0.1818 0.1818 0.1818 0 0 0 146.0866 0 0.6356 0.7879 0.5536 0.6256 0.7887 0 2017-04-30 16:37:05 1.2.5
DBpedia Spotlight AQUAINT 0.5345 0.768 0.4099 0.521 0.7611 0.4058 0.5388 0.7611 0.4275 0.5539 0.768 0.4331 0.54 0.54 0.54 0 0 0 116.16 0 0.5487 0.8081 0.4275 0.5628 0.8032 0 2017-04-30 16:34:41 1.2.5
DBpedia Spotlight DBpediaSpotlight 0.7069 0.82 0.6212 0.6881 0.8239 0.6103 0.6881 0.8239 0.6103 0.7069 0.82 0.6212 92.5862 0 0.6881 0.8239 0.6103 0.7069 0.82 0 2017-04-30 17:00:01 1.2.5
DBpedia Spotlight ERD2014 0.3836 1 0.2373 0.652 0.6593 0.6484 0.652 0.6593 0.6484 0.3836 1 0.2373 84.4725 0 0.652 0.6593 0.6484 0.3836 1 0 2017-04-30 16:35:07 1.2.5
DBpedia Spotlight IITB 0.3019 0.3449 0.2684 0.2845 0.3281 0.2519 0.3632 0.3281 0.4152 0.3885 0.3449 0.4447 0 0 0 0 0 0 686.8846 0 0.4777 0.5499 0.4248 0.4994 0.5693 0 2017-04-30 16:56:25 1.2.5
DBpedia Spotlight KORE50 0.458 0.5085 0.4167 0.4247 0.4763 0.398 0.4274 0.4763 0.4047 0.4598 0.5085 0.4196 0.98 0.98 0.98 0 0 0 81.64 0 0.4314 0.483 0.4047 0.4615 0.5128 0 2017-04-30 16:36:01 1.2.5
DBpedia Spotlight MSNBC 0.418 0.6696 0.3039 0.4373 0.7243 0.3301 0.4827 0.7243 0.3865 0.4586 0.6696 0.3487 0.25 0.25 0.25 0 0 0 159.45 0 0.4954 0.7636 0.3865 0.4676 0.7094 0 2017-04-30 16:36:05 1.2.5
DBpedia Spotlight N3-RSS-500 0.1998 0.4555 0.128 0.161 0.227 0.128 0.4107 0.447 0.394 0.3196 0.4555 0.2462 0.332 0.332 0.332 0 0 0 87.552 0 0.4847 0.522 0.466 0.3474 0.5899 0 2017-04-30 16:36:48 1.2.5
DBpedia Spotlight N3-Reuters-128 0.3309 0.5644 0.2341 0.265 0.4094 0.2096 0.4065 0.5032 0.3721 0.4137 0.5644 0.3265 0.4453 0.4453 0.4453 0 0 0 84.7656 0 0.4474 0.5726 0.3955 0.4364 0.6581 0 2017-04-30 16:36:59 1.2.5
WAT ACE2004 0.7182 0.8228 0.6373 0.8072 0.8646 0.7673 0.8686 0.8821 0.86 0.7959 0.8228 0.7708 0 0 0 0 0 0 61.5263 0.0408 0.8786 0.9043 0.8583 0.8134 0.8661 0 2017-04-30 16:38:02 1.2.5
WAT AIDA/CoNLL-Test A 0.7039 0.7684 0.6493 0.6633 0.7373 0.6151 0.7555 0.7373 0.7872 0.7848 0.7684 0.8019 0 0 0 0 0 0 241.7639 0.1066 0.8038 0.8249 0.7872 0.8226 0.8445 0 2017-04-30 16:39:22 1.2.5
WAT AIDA/CoNLL-Test B 0.7173 0.7767 0.6663 0.6962 0.7691 0.6481 0.7977 0.7734 0.8385 0.8045 0.7767 0.8343 0 0 0 0 0 0 196.9264 0.0872 0.8515 0.8685 0.8377 0.8462 0.8604 0 2017-04-30 16:39:49 1.2.5
WAT AQUAINT 0.7327 0.7717 0.6974 0.7361 0.7796 0.6993 0.7562 0.7796 0.7396 0.7539 0.7717 0.7369 0 0 0 0 0 0 90.06 0.0012 0.7789 0.8279 0.7396 0.7729 0.8125 0 2017-04-30 16:39:28 1.2.5
WAT DBpediaSpotlight 0.671 0.7213 0.6273 0.6875 0.752 0.6479 0.6875 0.752 0.6479 0.671 0.7213 0.6273 54.2069 0.0034 0.6875 0.752 0.6479 0.671 0.7213 0 2017-04-30 16:59:59 1.2.5
WAT ERD2014 0.76 0.9268 0.6441 0.8645 0.8736 0.8608 0.8645 0.8736 0.8608 0.76 0.9268 0.6441 33.8352 0.0307 0.8645 0.8736 0.8608 0.76 0.9268 0 2017-04-30 16:39:52 1.2.5
WAT IITB 0.4082 0.5327 0.3308 0.3928 0.5155 0.3195 0.5167 0.5155 0.523 0.5403 0.5327 0.5482 0 0 0 0 0 0 1,632.6827 0.0429 0.5955 0.682 0.5326 0.6139 0.6977 0 2017-04-30 17:12:59 1.2.5
WAT KORE50 0.6196 0.7117 0.5486 0.5215 0.5537 0.5013 0.5242 0.5537 0.508 0.622 0.7117 0.5524 0 0 0 0 0 0 248.08 0.1841 0.5282 0.5603 0.508 0.6245 0.7182 0 2017-04-30 16:40:31 1.2.5
WAT MSNBC 0.7285 0.8729 0.6252 0.7306 0.8885 0.6331 0.7966 0.8885 0.7325 0.7875 0.8729 0.7174 0 0 0 0 0 0 474.95 0.1334 0.8075 0.9151 0.7325 0.7956 0.8929 0 2017-04-30 16:40:42 1.2.5
WAT N3-RSS-500 0.4368 0.6385 0.332 0.3667 0.436 0.332 0.6283 0.634 0.638 0.6385 0.6385 0.6385 0 0 0 0 0 0 35.432 0.0614 0.739 0.753 0.732 0.7026 0.7812 0 2017-04-30 16:41:00 1.2.5
WAT N3-Reuters-128 0.516 0.7195 0.4023 0.4396 0.5931 0.3765 0.592 0.679 0.5651 0.6305 0.7195 0.561 0 0 0 0 0 0 52.1016 0.0667 0.6458 0.7532 0.5963 0.6598 0.8009 0 2017-04-30 16:41:07 1.2.5
DBpedia Spotlight GERDAQ-TrainingA 0.5284 0.7729 0.4014 0.449 0.5286 0.4095 0.449 0.5286 0.4095 0.5284 0.7729 0.4014 88.1687 0 0.449 0.5286 0.4095 0.5284 0.7729 0 2017-05-03 18:49:17 1.2.5
DBpedia Spotlight GERDAQ-TrainingB 0.5719 0.8128 0.4411 0.5063 0.588 0.4647 0.5063 0.588 0.4647 0.5719 0.8128 0.4411 100.754 0 0.5063 0.588 0.4647 0.5719 0.8128 0 2017-05-03 19:05:57 1.2.5
DBpedia Spotlight OKE 2016 Task 1 gold standard sample 0.291 0.4654 0.2116 0.2396 0.3758 0.1861 0.2682 0.381 0.2294 0.3291 0.4654 0.2546 0.5306 0.5306 0.5306 0 0 0 100.8316 0 0.2993 0.4502 0.2396 0.3535 0.5781 0 2017-05-03 19:04:22 1.2.5
AGDISTIS ACE2004 0.6471 0.6471 0.6471 0.7777 0.7777 0.7777 0.7813 0.7888 0.7775 0.6559 0.668 0.6443 0.7443 0.7535 0.7591 0.6087 0.5645 0.6604 581.0877 0 0.7775 0.7775 0.7775 0.6443 0.6443 0 2017-05-05 12:02:27 1.2.5
Dexter ACE2004 0.5517 0.9302 0.3922 0.7014 0.9208 0.6152 0.7614 0.9384 0.6801 0.6283 0.9302 0.4743 0 0 0 0 0 0 3,211.8421 0.5013 0.7655 0.9676 0.6789 0.6313 0.9597 0 2017-05-05 12:04:58 1.2.5
DoSeR ACE2004 0.8056 0.8593 0.7582 0.8762 0.9043 0.8543 0.9383 0.9218 0.9607 0.8872 0.8593 0.917 0.614 0.614 0.614 0 0 0 13,034.1754 0 0.9622 0.9639 0.9607 0.9225 0.928 0 2017-05-05 12:14:20 1.2.5
Entityclassifier.eu NER ACE2004 0.5582 0.6426 0.4935 0.7007 0.7338 0.6752 0.7264 0.7338 0.7256 0.6189 0.6426 0.5968 0.614 0.614 0.614 0 0 0 66.6909 0 0.7726 0.8148 0.7432 0.6681 0.7588 2 2017-05-05 12:02:18 1.2.5
FOX ACE2004 0 0 0 0.3684 0.3684 0.3684 0.386 0.386 0.386 0 0 0 0.614 0.614 0.614 0 0 0 13,099.8947 0 0.386 0.386 0.386 0 0 0 2017-05-05 12:14:45 1.2.5
FRED ACE2004 The annotator caused too many single errors. 2017-05-05 12:27:48 1.2.5
FREME NER ACE2004 0.535 0.7636 0.4118 0.6826 0.7127 0.6596 0.7349 0.7302 0.7454 0.6029 0.7636 0.498 0.614 0.614 0.614 0 0 0 497.0175 0 0.7548 0.7663 0.7454 0.6269 0.8456 0 2017-05-05 12:02:55 1.2.5
Kea ACE2004 The annotator caused too many single errors. 2017-05-05 12:02:56 1.2.5
NERFGUN ACE2004 The annotator caused too many single errors. 2017-05-05 12:02:56 1.2.5
PBOH ACE2004 0.7778 0.7778 0.7778 0.862 0.862 0.862 0.8799 0.8617 0.9085 0.8321 0.788 0.8814 0.6796 0.7281 0.6656 0.3947 0.6522 0.283 2,268.3509 0 0.9261 0.9261 0.9261 0.8814 0.8814 0 2017-05-05 12:05:05 1.2.5
TagMe 2 ACE2004 The annotator caused too many single errors. 2017-05-05 12:03:10 1.2.5
xLisa-NER ACE2004 0.6734 0.8877 0.5425 0.7731 0.9319 0.695 0.8362 0.9495 0.7737 0.7545 0.8877 0.6561 0 0 0 0 0 0 927.7719 0.032 0.8445 0.9701 0.7737 0.7685 0.9274 0 2017-05-05 12:04:03 1.2.5
xLisa-NGRAM ACE2004 0.732 0.8426 0.6471 0.8212 0.8863 0.7804 0.8841 0.9039 0.8724 0.8115 0.8426 0.7826 0 0 0 0 0 0 29,354.7193 0.015 0.896 0.9272 0.8724 0.8302 0.8839 0 2017-05-05 12:31:08 1.2.5
AGDISTIS AIDA/CoNLL-Complete 0.5461 0.5461 0.5461 0.5295 0.5295 0.5295 0.522 0.5458 0.5234 0.5657 0.5765 0.5552 0.3926 0.4132 0.4548 0.4758 0.4458 0.5101 804.2505 0 0.5262 0.5262 0.5262 0.5552 0.5552 0 2017-05-05 12:35:19 1.2.5
AIDA AIDA/CoNLL-Complete 0.6842 0.7419 0.6349 0.6585 0.7286 0.6126 0.7591 0.7294 0.8089 0.7686 0.7419 0.7972 0 0 0 0 0 0 11,361.9871 0.0886 0.8206 0.8311 0.8117 0.8105 0.8243 1 2017-05-05 16:41:31 1.2.5
Babelfy AIDA/CoNLL-Complete 0.6574 0.7032 0.6173 0.6006 0.6527 0.5654 0.6848