Skip to content
Snippets Groups Projects
Commit 21a6d99b authored by Ludwig Forsberg's avatar Ludwig Forsberg
Browse files

Added eval for replace

parent 94e82338
No related branches found
No related tags found
No related merge requests found
Showing
with 198 additions and 30 deletions
String evaluation
Precision macro: 0.7665002879740238
Recall macro: 0.7267807905453822
F1 macro: 0.7425910602562256
Precision micro: 0.7572702597906166
Recall micro: 0.7136853645167185
F1 micro: 0.7348320948170445
Fully correct: 49
Precision macro: 0.6432079215639523
Recall macro: 0.534456469816391
F1 macro: 0.5795537456054143
Precision micro: 0.7588690317417978
Recall micro: 0.5198245934587977
F1 micro: 0.6170028193450445
Fully correct: 15
Query evaluation
Precision macro: 0.23178077532982969
Recall macro: 0.2330422630268266
F1 macro: 0.23071235573769838
Precision micro: 0.24471582902770103
Recall micro: 0.0520583533173456
F1 micro: 0.08585317620901986
Fully correct: 113
Precision macro: 0.09897918806116392
Recall macro: 0.10099271675147162
F1 macro: 0.09781741011490794
Precision micro: 0.038526529232848286
Recall micro: 0.13491124260354231
F1 micro: 0.05993690848279043
Fully correct: 45
String evaluation
Precision macro: 0.7744778351782243
Recall macro: 0.7644896661920018
F1 macro: 0.7671636357770781
Precision micro: 0.767342384229124
Recall micro: 0.753882696875571
F1 micro: 0.7605529953917051
Fully correct: 43
Query evaluation
Precision macro: 0.29344079765845366
Recall macro: 0.2912452328457264
F1 macro: 0.2880080296265244
Precision micro: 0.4482891938913503
Recall micro: 0.37098064309709855
F1 micro: 0.40598739490842134
Fully correct: 136
String evaluation
Precision macro: 0.7759414376346168
Recall macro: 0.762772857276749
F1 macro: 0.766585649870327
Precision micro: 0.7640178239881174
Recall micro: 0.7518728302576284
F1 micro: 0.7578966755686528
Fully correct: 51
Precision macro: 0.6081546155962494
Recall macro: 0.5677965301019768
F1 macro: 0.584035978097797
Precision micro: 0.759024147373662
Recall micro: 0.5570984834642791
F1 micro: 0.6425711275026345
Fully correct: 32
Query evaluation
Precision macro: 0.2839751836267313
Recall macro: 0.28513289441888334
F1 macro: 0.28147025553512894
Precision micro: 0.79189944134076
Recall micro: 0.5386661599847893
F1 micro: 0.6411851181243624
Fully correct: 134
Precision macro: 0.18492610108764296
Recall macro: 0.19040564320131714
F1 macro: 0.18489665759898968
Precision micro: 0.703402742508852
Recall micro: 0.5807127882599337
F1 micro: 0.6361966007772532
Fully correct: 86
String evaluation
Precision macro: 0.774789650470584
Recall macro: 0.7160418159445401
F1 macro: 0.7400757389217517
Precision micro: 0.7663811989643498
Recall micro: 0.7030878859857482
F1 micro: 0.7333714503525824
Fully correct: 44
Query evaluation
Precision macro: 0.252621167977082
Recall macro: 0.25451100365168844
F1 macro: 0.24893154862140687
Precision micro: 0.1689507494646669
Recall micro: 0.43067685589518867
F1 micro: 0.24269455548090135
Fully correct: 114
String evaluation
Precision macro: 0.7667678732853834
Recall macro: 0.7468641820781904
F1 macro: 0.7541840407100193
Precision micro: 0.7568531731130305
Recall micro: 0.7365247579024301
F1 micro: 0.7465506065376425
Fully correct: 36
Query evaluation
Precision macro: 0.22656312749583524
Recall macro: 0.2276009986191178
F1 macro: 0.22246302625599743
Precision micro: 0.520817270624498
Recall micro: 0.14487935656836307
F1 micro: 0.2266968705087729
Fully correct: 105
String evaluation
Precision macro: 0.7640926626335188
Recall macro: 0.7594232885575304
F1 macro: 0.7595272646493744
Precision micro: 0.7591700629862912
Recall micro: 0.7487666727571716
F1 micro: 0.7539324809125195
Fully correct: 42
Query evaluation
Precision macro: 0.26176616477895803
Recall macro: 0.26364381478176135
F1 macro: 0.2580820469438238
Precision micro: 0.10599921578878509
Recall micro: 0.30679024021183454
F1 micro: 0.1575598620240952
Fully correct: 120
String evaluation
Precision macro: 0.7803434082130576
Recall macro: 0.7553485317103995
F1 macro: 0.7645178305202932
Precision micro: 0.7684766214177979
Recall micro: 0.7447469395212863
F1 micro: 0.7564257214438155
Fully correct: 46
Query evaluation
Precision macro: 0.28872581815954856
Recall macro: 0.28796930341044236
F1 macro: 0.28204960777034027
Precision micro: 0.5721027792343846
Recall micro: 0.32287659070730507
F1 micro: 0.41278849787290084
Fully correct: 133
String evaluation
Precision macro: 0.7695995314672359
Recall macro: 0.7684417506401945
F1 macro: 0.7668867809945137
Precision micro: 0.7604395604395604
Recall micro: 0.758633290699799
F1 micro: 0.7595353516875514
Fully correct: 40
Query evaluation
Precision macro: 0.27714170291023044
Recall macro: 0.27408026821475256
F1 macro: 0.271843459147678
Precision micro: 0.6412906478447028
Recall micro: 0.24889932491928138
F1 micro: 0.3586129122799806
Fully correct: 128
String evaluation
Precision macro: 0.773943598554494
Recall macro: 0.7631454850812833
F1 macro: 0.7662771340364111
Precision micro: 0.7667844522968198
Recall micro: 0.7533345514343139
F1 micro: 0.7599999999999999
Fully correct: 47
Query evaluation
Precision macro: 0.3039276717863791
Recall macro: 0.3054994848535596
F1 macro: 0.2981294725095505
Precision micro: 0.34752764713359163
Recall micro: 0.3280537556995401
F1 micro: 0.33751003019508397
Fully correct: 140
String evaluation
Precision macro: 0.7723849162078739
Recall macro: 0.761024189817965
F1 macro: 0.7642803764756501
Precision micro: 0.7691443549897024
Recall micro: 0.7505938242280285
F1 micro: 0.7597558720177547
Fully correct: 51
Query evaluation
Precision macro: 0.2948144967701334
Recall macro: 0.3014847860151734
F1 macro: 0.29248507525692047
Precision micro: 0.7059127291505111
Recall micro: 0.5354484919702206
F1 micro: 0.6089765006748405
Fully correct: 134
This diff is collapsed.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
This diff is collapsed.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
This diff is collapsed.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
Source diff could not be displayed: it is too large. Options to address this: view the blob.
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment