GERBIL Experiment

Your Experiments are completed

Experiment URI:
Type: A2KB
Matching: Mw - weak annotation match
Annotator Dataset Micro F1 score Micro Precision Micro Recall Macro F1 score Macro Precision Macro Recall InKB Macro F1 score InKB Macro Precision InKB Macro Recall InKB Micro F1 score InKB Micro Precision InKB Micro Recall EE Macro F1 score EE Macro Precision EE Macro Recall EE Micro F1 score EE Micro Precision EE Micro Recall avg millis/doc confidence threshold Error Count Timestamp GERBIL version
DBpedia Spotlight N3-Reuters-128 0.3201 0.2933 0.3523 0.2895 0.2751 0.3688 0.3501 0.3064 0.4938 0.3673 0.2933 0.4913 0.4453 0.4453 0.4453 0 0 0 87.8516 0 0 2017-05-03 22:08:30 1.2.5
DBpedia Spotlight N3-Reuters-128 Entity Recognition 0.5152 0.4721 0.567 0.4706 0.4586 0.581 0 0 2017-05-03 22:08:30 1.2.5
DBpedia Spotlight N3-Reuters-128 D2KB 0.4047 0.757 0.2761 0.329 0.5314 0.2601 0.4836 0.633 0.433 0.5105 0.757 0.3851 0.4453 0.4453 0.4453 0 0 0 0 0 2017-05-03 22:08:30 1.2.5
DBpedia Spotlight ACE2004 0.1823 0.107 0.6144 0.1744 0.1203 0.3851 0.1812 0.1203 0.4563 0.1871 0.107 0.7431 0.614 0.614 0.614 0 0 0 2,165.0702 0 0 2017-05-08 12:14:09 1.2.5
DBpedia Spotlight ACE2004 Entity Recognition 0.223 0.1309 0.7516 0.2254 0.1589 0.4799 0 0 2017-05-08 12:14:09 1.2.5
DBpedia Spotlight ACE2004 D2KB 0.6866 0.8821 0.5621 0.7915 0.9059 0.7239 0.855 0.9234 0.8096 0.7679 0.8821 0.6798 0.614 0.614 0.614 0 0 0 0 0 2017-05-08 12:14:09 1.2.5
DBpedia Spotlight AIDA/CoNLL-Complete 0.5446 0.5725 0.5193 0.5154 0.5424 0.5109 0.5781 0.5424 0.6696 0.6097 0.5725 0.6521 0.1457 0.1457 0.1457 0 0 0 1,183.0337 0 0 2017-05-08 12:40:15 1.2.5
DBpedia Spotlight AIDA/CoNLL-Complete Entity Recognition 0.7563 0.7951 0.7211 0.7258 0.7643 0.7189 0 0 2017-05-08 12:40:15 1.2.5
DBpedia Spotlight AIDA/CoNLL-Complete D2KB 0.6165 0.7819 0.5088 0.596 0.7903 0.4981 0.7002 0.7925 0.6536 0.7032 0.7819 0.6389 0.1457 0.1457 0.1457 0 0 0 0 0 2017-05-08 12:40:15 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test A 0.5293 0.563 0.4994 0.4962 0.5235 0.489 0.5554 0.5235 0.6308 0.5886 0.563 0.6168 0.1389 0.1389 0.1389 0 0 0 2,816.5972 0 0 2017-05-08 12:22:30 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test A Entity Recognition 0.7482 0.7958 0.7059 0.7237 0.7643 0.713 0 0 2017-05-08 12:22:30 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test A D2KB 0.5978 0.765 0.4906 0.5768 0.7677 0.4798 0.6715 0.7677 0.6186 0.6762 0.765 0.6059 0.1389 0.1389 0.1389 0 0 0 0 0 2017-05-08 12:22:30 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test B 0.5567 0.5798 0.5354 0.527 0.5498 0.5277 0.5838 0.5498 0.6749 0.6219 0.5798 0.6705 0.1818 0.1818 0.1818 0 0 0 2,713.2597 0 0 2017-05-08 12:22:35 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test B Entity Recognition 0.7615 0.7931 0.7324 0.7316 0.7597 0.7338 0 0 2017-05-08 12:22:35 1.2.5
DBpedia Spotlight AIDA/CoNLL-Test B D2KB 0.6322 0.7933 0.5255 0.6114 0.7963 0.5161 0.711 0.8007 0.6629 0.7193 0.7933 0.658 0.1818 0.1818 0.1818 0 0 0 0 0 2017-05-08 12:22:35 1.2.5
DBpedia Spotlight AIDA/CoNLL-Training 0.5455 0.5731 0.5204 0.5169 0.5449 0.5118 0.5819 0.5449 0.6772 0.6121 0.5731 0.6568 0.1385 0.1385 0.1385 0 0 0 1,410.185 0 0 2017-05-08 12:34:52 1.2.5
DBpedia Spotlight AIDA/CoNLL-Training Entity Recognition 0.757 0.7953 0.7223 0.7248 0.7654 0.7165 0 0 2017-05-08 12:34:52 1.2.5
DBpedia Spotlight AIDA/CoNLL-Training D2KB 0.6173 0.7833 0.5094 0.5967 0.794 0.4979 0.7041 0.7961 0.6593 0.7062 0.7833 0.6429 0.1385 0.1385 0.1385 0 0 0 0 0 2017-05-08 12:34:52 1.2.5
DBpedia Spotlight AQUAINT 0.4133 0.3539 0.4966 0.4049 0.3639 0.4941 0.4142 0.3639 0.5218 0.4227 0.3539 0.5247 0.54 0.54 0.54 0 0 0 457.84 0 0 2017-05-08 12:12:15 1.2.5
DBpedia Spotlight AQUAINT Entity Recognition 0.5186 0.4441 0.6231 0.5149 0.4643 0.6257 0 0 2017-05-08 12:12:15 1.2.5
DBpedia Spotlight AQUAINT D2KB 0.5956 0.8417 0.4608 0.5845 0.8417 0.46 0.6031 0.8417 0.4838 0.6169 0.8417 0.4869 0.54 0.54 0.54 0 0 0 0 0 2017-05-08 12:12:15 1.2.5
DBpedia Spotlight B1 (uploaded) 0.6875 0.7076 0.6685 0.6624 0.7363 0.6341 0.6801 0.7363 0.6692 0.6974 0.7076 0.6875 0.9 0.9 0.9 0 0 0 3,711.22 0 0 2017-05-08 12:18:55 1.2.5
DBpedia Spotlight B1 (uploaded) Entity Recognition 0.8438 0.8684 0.8204 0.8243 0.9082 0.7944 0 0 2017-05-08 12:18:55 1.2.5
DBpedia Spotlight B1 (uploaded) D2KB 0.7585 0.9867 0.616 0.708 0.935 0.5907 0.7316 0.935 0.6259 0.7716 0.9867 0.6335 0.9 0.9 0.9 0 0 0 0 0 2017-05-08 12:18:55 1.2.5
DBpedia Spotlight B10 (uploaded) 0.5709 0.6795 0.4923 0.5654 0.712 0.4916 0.711 0.712 0.7583 0.7098 0.6795 0.743 0.01 0.01 0.01 0 0 0 3,616.2 0 0 2017-05-08 12:18:32 1.2.5
DBpedia Spotlight B10 (uploaded) Entity Recognition 0.7397 0.8803 0.6378 0.7266 0.8987 0.6385 0 0 2017-05-08 12:18:32 1.2.5
DBpedia Spotlight B10 (uploaded) D2KB 0.6187 0.8971 0.4721 0.6071 0.9055 0.476 0.7879 0.9055 0.7329 0.7943 0.8971 0.7126 0.01 0.01 0.01 0 0 0 0 0 2017-05-08 12:18:32 1.2.5
DBpedia Spotlight B11 (uploaded) 0.6855 0.6516 0.7231 0.686 0.6689 0.7176 0.686 0.6689 0.7176 0.6855 0.6516 0.7231 322.446 0 0 2017-05-08 13:29:26 1.2.5
DBpedia Spotlight B11 (uploaded) Entity Recognition 0.8716 0.8285 0.9194 0.8731 0.8483 0.9184 0 0 2017-05-08 13:29:26 1.2.5
DBpedia Spotlight B11 (uploaded) D2KB 0.7575 0.9765 0.6188 0.7252 0.9717 0.6151 0.7252 0.9717 0.6151 0.7575 0.9765 0.6188 0 0 2017-05-08 13:29:26 1.2.5
DBpedia Spotlight B12 (uploaded) 0.7921 0.7537 0.8345 0.7963 0.7615 0.8365 0.7963 0.7615 0.8365 0.7921 0.7537 0.8345 2,957.7 0 0 2017-05-08 12:13:33 1.2.5
DBpedia Spotlight B12 (uploaded) Entity Recognition 0.9138 0.8696 0.9628 0.9138 0.8729 0.9612 0 0 2017-05-08 12:13:33 1.2.5
DBpedia Spotlight B12 (uploaded) D2KB 0.8604 0.9459 0.789 0.8626 0.95 0.7948 0.8626 0.95 0.7948 0.8604 0.9459 0.789 0 0 2017-05-08 12:13:33 1.2.5
DBpedia Spotlight B13 (uploaded) 0.3269 0.2323 0.5517 0.3328 0.2643 0.5247 0.3493 0.2643 0.6235 0.3408 0.2323 0.64 0 0 0 0 0 0 4,453.5 0 0 2017-05-08 12:13:29 1.2.5
DBpedia Spotlight B13 (uploaded) Entity Recognition 0.4972 0.3532 0.8391 0.522 0.4122 0.8111 0 0 2017-05-08 12:13:29 1.2.5
DBpedia Spotlight B13 (uploaded) D2KB 0.6635 0.8903 0.5287 0.6271 0.8857 0.5042 0.6983 0.8857 0.6 0.7263 0.8903 0.6133 0 0 0 0 0 0 0 0 2017-05-08 12:13:29 1.2.5
DBpedia Spotlight B2 (uploaded) 0.6817 0.6954 0.6685 0.6572 0.723 0.6341 0.6748 0.723 0.6692 0.6914 0.6954 0.6875 0.9 0.9 0.9 0 0 0 4,077.91 0 0 2017-05-08 12:19:26 1.2.5
DBpedia Spotlight B2 (uploaded) Entity Recognition 0.8366 0.8534 0.8204 0.818 0.8926 0.7944 0 0 2017-05-08 12:19:26 1.2.5
DBpedia Spotlight B2 (uploaded) D2KB 0.7585 0.9867 0.616 0.708 0.935 0.5907 0.7316 0.935 0.6259 0.7716 0.9867 0.6335 0.9 0.9 0.9 0 0 0 0 0 2017-05-08 12:19:26 1.2.5
DBpedia Spotlight B3 (uploaded) 0.5717 0.5642 0.5795 0.5827 0.6195 0.582 0.6101 0.6195 0.6483 0.5961 0.5642 0.632 0.84 0.84 0.84 0 0 0 3,493.3 0 0 2017-05-08 12:18:22 1.2.5
DBpedia Spotlight B3 (uploaded) Entity Recognition 0.8049 0.7942 0.8159 0.7965 0.8172 0.8225 0 0 2017-05-08 12:18:22 1.2.5
DBpedia Spotlight B3 (uploaded) D2KB 0.6893 0.9873 0.5295 0.6674 0.99 0.532 0.7124 0.99 0.59 0.7287 0.9873 0.5774 0.84 0.84 0.84 0 0 0 0 0 2017-05-08 12:18:22 1.2.5
DBpedia Spotlight B4 (uploaded) 0.7612 0.725 0.8011 0.7683 0.7547 0.7993 0.7798 0.7547 0.825 0.7726 0.725 0.827 0.84 0.84 0.84 0 0 0 4,509.38 0 0 2017-05-08 12:20:03 1.2.5
DBpedia Spotlight B4 (uploaded) Entity Recognition 0.8766 0.835 0.9227 0.8817 0.861 0.9242 0 0 2017-05-08 12:20:03 1.2.5
DBpedia Spotlight B4 (uploaded) D2KB 0.8444 0.9925 0.7348 0.831 0.993 0.7347 0.8459 0.993 0.7568 0.8599 0.9925 0.7586 0.84 0.84 0.84 0 0 0 0 0 2017-05-08 12:20:03 1.2.5
DBpedia Spotlight B5 (uploaded) 0.4164 0.4444 0.3917 0.4195 0.4936 0.3937 0.4562 0.4936 0.4681 0.4508 0.4444 0.4573 0.46 0.46 0.46 0 0 0 4,138.44 0 0 2017-05-08 12:19:14 1.2.5
DBpedia Spotlight B5 (uploaded) Entity Recognition 0.7757 0.8279 0.7297 0.7525 0.859 0.7284 0 0 2017-05-08 12:19:14 1.2.5
DBpedia Spotlight B5 (uploaded) D2KB 0.5162 0.9696 0.3517 0.4758 0.8926 0.3552 0.5319 0.8926 0.4191 0.5769 0.9696 0.4106 0.46 0.46 0.46 0 0 0 0 0 2017-05-08 12:19:14 1.2.5
DBpedia Spotlight B6 (uploaded) 0.4319 0.4446 0.4199 0.4323 0.4812 0.4172 0.4701 0.4812 0.4929 0.4647 0.4446 0.4867 0.46 0.46 0.46 0 0 0 3,234.63 0 0 2017-05-08 12:17:57 1.2.5
DBpedia Spotlight B6 (uploaded) Entity Recognition 0.7714 0.7941 0.75 0.7534 0.8218 0.7443 0 0 2017-05-08 12:17:57 1.2.5
DBpedia Spotlight B6 (uploaded) D2KB 0.5429 0.9665 0.3775 0.5018 0.8893 0.3756 0.5588 0.8893 0.4421 0.6023 0.9665 0.4375 0.46 0.46 0.46 0 0 0 0 0 2017-05-08 12:17:57 1.2.5
DBpedia Spotlight B7 (uploaded) 0.6692 0.6698 0.6686 0.666 0.7227 0.6475 0.6772 0.7227 0.6726 0.6782 0.6698 0.6868 0.93 0.93 0.93 0 0 0 4,146.13 0 0 2017-05-08 12:19:33 1.2.5
DBpedia Spotlight B7 (uploaded) Entity Recognition 0.8436 0.8444 0.8428 0.8146 0.8654 0.8076 0 0 2017-05-08 12:19:33 1.2.5
DBpedia Spotlight B7 (uploaded) D2KB 0.7683 0.997 0.625 0.7158 0.96 0.5996 0.7307 0.96 0.6197 0.7811 0.997 0.642 0.93 0.93 0.93 0 0 0 0 0 2017-05-08 12:19:33 1.2.5
DBpedia Spotlight B8 (uploaded) 0.7116 0.7066 0.7167 0.7019 0.7433 0.6922 0.7105 0.7433 0.7112 0.7175 0.7066 0.7288 0.93 0.93 0.93 0 0 0 3,910.48 0 0 2017-05-08 12:19:12 1.2.5
DBpedia Spotlight B8 (uploaded) Entity Recognition 0.8487 0.8427 0.8548 0.8272 0.8641 0.8254 0 0 2017-05-08 12:19:12 1.2.5
DBpedia Spotlight B8 (uploaded) D2KB 0.7989 0.9964 0.6667 0.749 0.96 0.6381 0.76 0.96 0.6538 0.8069 0.9964 0.678 0.93 0.93 0.93 0 0 0 0 0 2017-05-08 12:19:12 1.2.5
DBpedia Spotlight B9 (uploaded) 0.5717 0.666 0.5008 0.5672 0.7045 0.4999 0.7084 0.7045 0.762 0.705 0.666 0.7488 0.01 0.01 0.01 0 0 0 4,232.48 0 0 2017-05-08 12:19:24 1.2.5
DBpedia Spotlight B9 (uploaded) Entity Recognition 0.7455 0.8685 0.6531 0.7349 0.8942 0.6559 0 0 2017-05-08 12:19:24 1.2.5
DBpedia Spotlight B9 (uploaded) D2KB 0.6251 0.8947 0.4804 0.6131 0.9025 0.484 0.7902 0.9025 0.737 0.7969 0.8947 0.7183 0.01 0.01 0.01 0 0 0 0 0 2017-05-08 12:19:24 1.2.5
DBpedia Spotlight DBpediaSpotlight 0.3694 0.7193 0.2485 0.3156 0.5503 0.2457 0.3156 0.5503 0.2457 0.3694 0.7193 0.2485 1,269.9828 0 0 2017-05-08 12:13:06 1.2.5
DBpedia Spotlight DBpediaSpotlight Entity Recognition 0.4459 0.8684 0.3 0.3887 0.6899 0.297 0 0 2017-05-08 12:13:06 1.2.5
DBpedia Spotlight DBpediaSpotlight D2KB 0.3885 0.931 0.2455 0.3277 0.6609 0.2443 0.3277 0.6609 0.2443 0.3885 0.931 0.2455 0 0 2017-05-08 12:13:06 1.2.5
DBpedia Spotlight IITB 0.2633 0.6001 0.1686 0.2509 0.5687 0.1648 0.3584 0.5687 0.2698 0.3813 0.6001 0.2794 0 0 0 0 0 0 4,338.402 0 2 2017-05-08 12:20:04 1.2.5
DBpedia Spotlight IITB Entity Recognition 0.3792 0.8643 0.2428 0.3695 0.846 0.2423 0 0 2017-05-08 12:20:04 1.2.5
DBpedia Spotlight IITB D2KB 0.2626 0.7641 0.1586 0.2491 0.7101 0.1546 0.3751 0.7197 0.2633 0.391 0.7641 0.2627 0 0 0 0 0 0 0 0 2017-05-08 12:20:04 1.2.5
DBpedia Spotlight KORE50 0.3412 0.5373 0.25 0.2703 0.3783 0.23 0.2736 0.3783 0.2333 0.3429 0.5373 0.2517 0.98 0.98 0.98 0 0 0 5,035.16 0 0 2017-05-08 12:17:22 1.2.5
DBpedia Spotlight KORE50 Entity Recognition 0.5118 0.806 0.375 0.4429 0.6183 0.3707 0 0 2017-05-08 12:17:22 1.2.5
DBpedia Spotlight KORE50 D2KB 0.3571 0.6731 0.2431 0.2711 0.3867 0.2233 0.2744 0.3867 0.2267 0.359 0.6731 0.2448 0.98 0.98 0.98 0 0 0 0 0 2017-05-08 12:17:22 1.2.5
DBpedia Spotlight MSNBC 0.4566 0.4593 0.4538 0.4603 0.4789 0.4915 0.4925 0.4789 0.5675 0.4881 0.4593 0.5207 0.25 0.25 0.25 0 0 0 5,232.25 0 0 2017-05-08 12:15:17 1.2.5
DBpedia Spotlight MSNBC Entity Recognition 0.5751 0.5786 0.5716 0.5636 0.5866 0.6054 0 0 2017-05-08 12:15:17 1.2.5
DBpedia Spotlight MSNBC D2KB 0.5525 0.8543 0.4083 0.5765 0.8947 0.4418 0.6388 0.8947 0.5117 0.6052 0.8543 0.4685 0.25 0.25 0.25 0 0 0 0 0 2017-05-08 12:15:17 1.2.5
DBpedia Spotlight Microposts2014-Test 0.366 0.365 0.367 0.53 0.5586 0.5278 0.53 0.5586 0.5278 0.366 0.365 0.367 1,362.582 0 0 2017-05-08 12:38:01 1.2.5
DBpedia Spotlight Microposts2014-Test Entity Recognition 0.47 0.4687 0.4713 0.594 0.6283 0.5939 0 0 2017-05-08 12:38:01 1.2.5
DBpedia Spotlight Microposts2014-Test D2KB 0.4933 0.8378 0.3495 0.6353 0.6919 0.6117 0.6353 0.6919 0.6117 0.4933 0.8378 0.3495 0 0 2017-05-08 12:38:01 1.2.5
DBpedia Spotlight Microposts2014-Train 0.4477 0.4937 0.4095 0.4988 0.5347 0.4985 0.4989 0.5347 0.4988 0.4478 0.4937 0.4098 0.9987 0.9987 0.9987 0 0 0 850.7688 0 0 2017-05-08 12:50:26 1.2.5
DBpedia Spotlight Microposts2014-Train Entity Recognition 0.5858 0.6461 0.5358 0.5892 0.6376 0.588 0 0 2017-05-08 12:50:26 1.2.5
DBpedia Spotlight Microposts2014-Train D2KB 0.5321 0.8328 0.3909 0.6273 0.716 0.5901 0.6273 0.716 0.5901 0.5323 0.8328 0.3912 0.9987 0.9987 0.9987 0 0 0 0 0 2017-05-08 12:50:26 1.2.5
DBpedia Spotlight N3-RSS-500 0.2761 0.2405 0.324 0.2555 0.2426 0.324 0.3579 0.3126 0.498 0.3471 0.2405 0.6231 0.332 0.332 0.332 0 0 0 1,693.948 0 0 2017-05-08 12:29:25 1.2.5
DBpedia Spotlight N3-RSS-500 Entity Recognition 0.4602 0.4009 0.54 0.4461 0.4411 0.54 0 0 2017-05-08 12:29:25 1.2.5
DBpedia Spotlight N3-RSS-500 D2KB 0.4279 0.7221 0.304 0.3483 0.437 0.304 0.634 0.661 0.627 0.6461 0.7221 0.5846 0.332 0.332 0.332 0 0 0 0 0 2017-05-08 12:29:25 1.2.5
DBpedia Spotlight OKE 2015 Task 1 evaluation dataset 0.4577 0.5873 0.375 0.4343 0.5761 0.3736 0.4913 0.5761 0.4672 0.5193 0.5873 0.4654 0.396 0.396 0.396 0 0 0 2,742.6733 0 0 2017-05-08 12:22:02 1.2.5
DBpedia Spotlight OKE 2015 Task 1 evaluation dataset Entity Recognition 0.6121 0.7854 0.5015 0.5885 0.7865 0.5022 0 0 2017-05-08 12:22:02 1.2.5
DBpedia Spotlight OKE 2015 Task 1 evaluation dataset D2KB 0.4805 0.8538 0.3343 0.4454 0.7657 0.3336 0.5175 0.7657 0.4198 0.5585 0.8538 0.415 0.396 0.396 0.396 0 0 0 0 0 2017-05-08 12:22:02 1.2.5
DBpedia Spotlight OKE 2015 Task 1 gold standard sample 0.5546 0.625 0.4985 0.5317 0.6203 0.5048 0.5831 0.6414 0.5712 0.5913 0.625 0.5611 0.7053 0.7053 0.7053 0 0 0 2,518.2737 0 0 2017-05-08 12:21:57 1.2.5
DBpedia Spotlight OKE 2015 Task 1 gold standard sample Entity Recognition 0.7439 0.8382 0.6686 0.7095 0.8292 0.6697 0 0 2017-05-08 12:21:57 1.2.5
DBpedia Spotlight OKE 2015 Task 1 gold standard sample D2KB 0.6104 0.8833 0.4663 0.5554 0.7467 0.4671 0.6136 0.7782 0.533 0.6584 0.8833 0.5248 0.7053 0.7053 0.7053 0 0 0 0 0 2017-05-08 12:21:57 1.2.5