Skip to content
Snippets Groups Projects
Commit 164d3b72 authored by Ludwig Forsberg's avatar Ludwig Forsberg
Browse files

Added evals

parent a946de67
Branches
No related tags found
No related merge requests found
Showing
with 400 additions and 0 deletions
String evaluation
Precision macro: 0.6522104894672984
Recall macro: 0.594619269619269
F1 macro: 0.6185814019870951
Precision micro: 0.6443371555019111
Recall micro: 0.585236616115476
F1 micro: 0.6133665262351589
Fully correct: 0
Query evaluation
Precision macro: 0.054474708171206226
Recall macro: 0.054474708171206226
F1 macro: 0.054474708171206226
Precision micro: 0.22222222222204585
Recall micro: 0.041358936484484285
F1 micro: 0.06973848067090936
Fully correct: 28
String evaluation
Precision macro: 0.6714387536371965
Recall macro: 0.6642493855042485
F1 macro: 0.666258116055317
Precision micro: 0.6648209671465486
Recall micro: 0.6581399598026676
F1 micro: 0.6614635937930401
Fully correct: 3
Query evaluation
Precision macro: 0.06615216711373105
Recall macro: 0.06580440798437961
F1 macro: 0.06593956216295424
Precision micro: 0.20267916945746547
Recall micro: 0.6647627416519919
F1 micro: 0.3106457242224716
Fully correct: 33
String evaluation
Precision macro: 0.6549880782857428
Recall macro: 0.6066869684573959
F1 macro: 0.6264998680125151
Precision micro: 0.6512229071385961
Recall micro: 0.5983921067056459
F1 micro: 0.6236907255760807
Fully correct: 1
Query evaluation
Precision macro: 0.0622568093385214
Recall macro: 0.0622568093385214
F1 macro: 0.0622568093385214
Precision micro: 0.9384422110552174
Recall micro: 0.6971535230984276
F1 micro: 0.7999999999510453
Fully correct: 32
String evaluation
Precision macro: 0.6119067378794998
Recall macro: 0.6102584510172049
F1 macro: 0.6064009957319122
Precision micro: 0.6034388147064204
Recall micro: 0.6027772702357025
F1 micro: 0.603107861060329
Fully correct: 0
Query evaluation
Precision macro: 0.042801556420233464
Recall macro: 0.042801556420233464
F1 macro: 0.042801556420233464
Precision micro: 0.14473684210516793
Recall micro: 0.0023182297154899652
F1 micro: 0.0045633685926237625
Fully correct: 22
String evaluation
Precision macro: 0.6635259789929049
Recall macro: 0.6393453012616431
F1 macro: 0.6490068009277149
Precision micro: 0.660373760488177
Recall micro: 0.6327425543577563
F1 micro: 0.6462629467201643
Fully correct: 0
Query evaluation
Precision macro: 0.05408801991444522
Recall macro: 0.05304382285746201
F1 macro: 0.05330299406944705
Precision micro: 0.5624999999999235
Recall micro: 0.1917554423344052
F1 micro: 0.28601036265636115
Fully correct: 27
String evaluation
Precision macro: 0.667392831984271
Recall macro: 0.6589245115023319
F1 macro: 0.6613586509242774
Precision micro: 0.6600110926234054
Recall micro: 0.6522930750959255
F1 micro: 0.6561293879801506
Fully correct: 3
Query evaluation
Precision macro: 0.06420233463035019
Recall macro: 0.06381322957198443
F1 macro: 0.06398616515348032
Precision micro: 0.9168704156478656
Recall micro: 0.6170300287947093
F1 micro: 0.7376444553243847
Fully correct: 32
String evaluation
Precision macro: 0.6686044446258451
Recall macro: 0.6541809142003686
F1 macro: 0.6592613353007973
Precision micro: 0.6616906139205075
Recall micro: 0.6479079115658688
F1 micro: 0.6547267355982274
Fully correct: 1
Query evaluation
Precision macro: 0.06576117166541799
Recall macro: 0.06432786955006901
F1 macro: 0.06475997634354995
Precision micro: 0.6993670886074842
Recall micro: 0.2041570438798982
F1 micro: 0.3160529138012505
Fully correct: 32
String evaluation
Precision macro: 0.6651949218097074
Recall macro: 0.657697220634963
F1 macro: 0.6597884211605066
Precision micro: 0.6592633722006292
Recall micro: 0.6508313539192399
F1 micro: 0.6550202280250093
Fully correct: 2
Query evaluation
Precision macro: 0.06576117166541799
Recall macro: 0.06393876449170326
F1 macro: 0.06448976449746262
Precision micro: 0.7042925278218276
Recall micro: 0.27328809376926133
F1 micro: 0.3937777777374619
Fully correct: 32
String evaluation
Precision macro: 0.6698455403221937
Recall macro: 0.6583141728569741
F1 macro: 0.6622808406988272
Precision micro: 0.6631363805276849
Recall micro: 0.6521103599488398
F1 micro: 0.6575771533855367
Fully correct: 1
Query evaluation
Precision macro: 0.0622568093385214
Recall macro: 0.0622568093385214
F1 macro: 0.0622568093385214
Precision micro: 0.3814143477150783
Recall micro: 0.6978047641288792
F1 micro: 0.4932320897528945
Fully correct: 32
String evaluation
Precision macro: 0.6678473007753162
Recall macro: 0.6594372337562998
F1 macro: 0.6620287867776813
Precision micro: 0.6611172770995191
Recall micro: 0.6530239356842682
F1 micro: 0.6570456843459876
Fully correct: 1
Query evaluation
Precision macro: 0.06614785992217899
Recall macro: 0.06575875486381322
F1 macro: 0.06593169044530911
Precision micro: 0.9409918392968649
Recall micro: 0.936289818863152
F1 micro: 0.9386349404634042
Fully correct: 33
String evaluation
Precision macro: 0.654879421270471
Recall macro: 0.5874606964587504
F1 macro: 0.615571733473065
Precision micro: 0.6467692307692308
Recall micro: 0.5761008587611913
F1 micro: 0.6093931194433707
Fully correct: 0
Query evaluation
Precision macro: 0.054474708171206226
Recall macro: 0.054474708171206226
F1 macro: 0.054474708171206226
Precision micro: 0.22764227642257914
Recall micro: 0.01766561514195472
F1 micro: 0.03278688523253219
Fully correct: 28
String evaluation
Precision macro: 0.6598485118426752
Recall macro: 0.6538803932772801
F1 macro: 0.6548936667440562
Precision micro: 0.6530725226056467
Recall micro: 0.646628905536269
F1 micro: 0.6498347410943812
Fully correct: 1
Query evaluation
Precision macro: 0.06402409551199942
Recall macro: 0.06471697460843477
F1 macro: 0.06340717381088047
Precision micro: 0.6702127659573449
Recall micro: 0.273403595784236
F1 micro: 0.38837516508430303
Fully correct: 32
String evaluation
Precision macro: 0.6452414533153833
Recall macro: 0.5756461653348808
F1 macro: 0.6040464279599678
Precision micro: 0.6366632337796087
Recall micro: 0.5647725196418784
F1 micro: 0.5985670023237801
Fully correct: 0
Query evaluation
Precision macro: 0.06031128404669261
Recall macro: 0.06031128404669261
F1 macro: 0.06031128404669261
Precision micro: 0.22794117647042064
Recall micro: 0.06066536203521318
F1 micro: 0.09582689332070835
Fully correct: 31
String evaluation
Precision macro: 0.6490175734339154
Recall macro: 0.6418494659253412
F1 macro: 0.6429887309215154
Precision micro: 0.6395434462444771
Recall micro: 0.6347524209756988
F1 micro: 0.6371389270976615
Fully correct: 1
Query evaluation
Precision macro: 0.06031128404669261
Recall macro: 0.06031128404669261
F1 macro: 0.06031128404669261
Precision micro: 0.22627737226260858
Recall micro: 0.018810679611649343
F1 micro: 0.03473389354324707
Fully correct: 31
String evaluation
Precision macro: 0.650388430203605
Recall macro: 0.6163218158840718
F1 macro: 0.6295640490628309
Precision micro: 0.6415057915057915
Recall micro: 0.6071624337657592
F1 micro: 0.6238618229606684
Fully correct: 0
Query evaluation
Precision macro: 0.05252918287937743
Recall macro: 0.05252918287937743
F1 macro: 0.05252918287937743
Precision micro: 0.005915863277826339
Recall micro: 0.01701323251417662
F1 micro: 0.008779060277107724
Fully correct: 27
String evaluation
Precision macro: 0.6636305598854232
Recall macro: 0.6427171293902806
F1 macro: 0.6509304574893502
Precision micro: 0.6551139574307779
Recall micro: 0.6354832815640417
F1 micro: 0.6451493229456502
Fully correct: 0
Query evaluation
Precision macro: 0.0599245957899316
Recall macro: 0.05888039873294839
F1 macro: 0.05913956994493343
Precision micro: 0.6566929133857233
Recall micro: 0.18980427856166637
F1 micro: 0.2944915253889186
Fully correct: 30
String evaluation
Precision macro: 0.6595198737708462
Recall macro: 0.6231635420351366
F1 macro: 0.637718957676385
Precision micro: 0.6507936507936508
Recall micro: 0.6142883245021012
F1 micro: 0.6320142870570543
Fully correct: 0
Query evaluation
Precision macro: 0.05467303841940237
Recall macro: 0.05423805099018526
F1 macro: 0.05443092701133385
Precision micro: 0.010989010989010757
Recall micro: 0.027926960257785825
F1 micro: 0.015771913820557232
Fully correct: 27
String evaluation
Precision macro: 0.6622553840452665
Recall macro: 0.6540301246526922
F1 macro: 0.6564854173325522
Precision micro: 0.6546563192904656
Recall micro: 0.6473597661246118
F1 micro: 0.6509875976113919
Fully correct: 2
Query evaluation
Precision macro: 0.0619268787077781
Recall macro: 0.060567488575564106
F1 macro: 0.060948065771763364
Precision micro: 0.33820138355108853
Recall micro: 0.23542001070089696
F1 micro: 0.27760252361089377
Fully correct: 30
String evaluation
Precision macro: 0.6580696972720314
Recall macro: 0.6473398683029027
F1 macro: 0.6508385280443701
Precision micro: 0.6530080089402124
Recall micro: 0.6405993056824411
F1 micro: 0.6467441431470208
Fully correct: 2
Query evaluation
Precision macro: 0.0680729711572563
Recall macro: 0.06829151436103366
F1 macro: 0.06731459515062395
Precision micro: 0.4018348623852842
Recall micro: 0.23409941207908957
F1 micro: 0.2958459979271161
Fully correct: 33
String evaluation
Precision macro: 0.6624185477298313
Recall macro: 0.6479861092215169
F1 macro: 0.6531446498335278
Precision micro: 0.6546574575322008
Recall micro: 0.6407820208295267
F1 micro: 0.6476454293628808
Fully correct: 1
Query evaluation
Precision macro: 0.0599245957899316
Recall macro: 0.05888039873294839
F1 macro: 0.05913956994493343
Precision micro: 0.3965980304386395
Recall micro: 0.27345679012343993
F1 micro: 0.32371209348473046
Fully correct: 30
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment