Skip to content
Snippets Groups Projects
Commit 68a9d772 authored by MORIOKA Tomohiko's avatar MORIOKA Tomohiko
Browse files

New files.

parent 0c2705d6
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 86788 additions and 0 deletions
seed_KTp2a/matrix.bin 0 → 100644
+ 0
− 0
View file @ 68a9d772
File added
seed_KTp2a/matrix.def 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/matrix.def
\ No newline at end of file
seed_KTp2a/mk-final.sh 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/mk-final.sh
\ No newline at end of file
seed_KTp2a/model 0 → 100644
+ 85888
− 0
View file @ 68a9d772
Source diff could not be displayed: it is too large. Options to address this: view the blob.
seed_KTp2a/rewrite.def 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/rewrite.def
\ No newline at end of file
seed_KTp2a/sys.dic 0 → 100644
+ 0
− 0
View file @ 68a9d772
File added
seed_KTp2a/system-eval.results 0 → 100644
+ 892
− 0
View file @ 68a9d772
mecab-system-eval -l "0 1 2 3 4 5 6 7"
test.KT0 (corpus.KT0.mc):
precision recall F
LEVEL 0: 78.7362(74908/95138) 86.5328(74908/86566) 82.4506
LEVEL 1: 73.1853(69627/95138) 80.4323(69627/86566) 76.6378
LEVEL 2: 71.8703(68376/95138) 78.9871(68376/86566) 75.2609
LEVEL 3: 65.2379(62066/95138) 71.6979(62066/86566) 68.3155
LEVEL 4: 61.8323(58826/95138) 67.9551(58826/86566) 64.7493
LEVEL 5: 61.8323(58826/95138) 67.9551(58826/86566) 64.7493
LEVEL 6: 61.8323(58826/95138) 67.9551(58826/86566) 64.7493
LEVEL 7: 61.6694(58671/95138) 67.7760(58671/86566) 64.5787
test.KT2 (corpus.KT0.mc):
precision recall F
LEVEL 0: 96.2391(6167/6408) 97.9511(6167/6296) 97.0875
LEVEL 1: 95.3808(6112/6408) 97.0775(6112/6296) 96.2217
LEVEL 2: 94.9594(6085/6408) 96.6487(6085/6296) 95.7966
LEVEL 3: 93.5237(5993/6408) 95.1874(5993/6296) 94.3482
LEVEL 4: 92.4938(5927/6408) 94.1391(5927/6296) 93.3092
LEVEL 5: 92.4938(5927/6408) 94.1391(5927/6296) 93.3092
LEVEL 6: 92.4938(5927/6408) 94.1391(5927/6296) 93.3092
LEVEL 7: 92.2909(5914/6408) 93.9327(5914/6296) 93.1045
test.misc (corpus.KT0.mc):
precision recall F
LEVEL 0: 94.5946(70/74) 97.2222(70/72) 95.8904
LEVEL 1: 91.8919(68/74) 94.4444(68/72) 93.1507
LEVEL 2: 89.1892(66/74) 91.6667(66/72) 90.4110
LEVEL 3: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 4: 77.0270(57/74) 79.1667(57/72) 78.0822
LEVEL 5: 77.0270(57/74) 79.1667(57/72) 78.0822
LEVEL 6: 77.0270(57/74) 79.1667(57/72) 78.0822
LEVEL 7: 74.3243(55/74) 76.3889(55/72) 75.3425
test.kanjikai (corpus.KT0.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 84.7458(50/59) 71.4286(50/70) 77.5194
LEVEL 2: 84.7458(50/59) 71.4286(50/70) 77.5194
LEVEL 3: 71.1864(42/59) 60.0000(42/70) 65.1163
LEVEL 4: 61.0169(36/59) 51.4286(36/70) 55.8140
LEVEL 5: 61.0169(36/59) 51.4286(36/70) 55.8140
LEVEL 6: 61.0169(36/59) 51.4286(36/70) 55.8140
LEVEL 7: 59.3220(35/59) 50.0000(35/70) 54.2636
test.ryomou (corpus.KT0.mc):
precision recall F
LEVEL 0: 94.1538(306/325) 96.2264(306/318) 95.1788
LEVEL 1: 82.1538(267/325) 83.9623(267/318) 83.0482
LEVEL 2: 80.9231(263/325) 82.7044(263/318) 81.8040
LEVEL 3: 71.3846(232/325) 72.9560(232/318) 72.1617
LEVEL 4: 66.7692(217/325) 68.2390(217/318) 67.4961
LEVEL 5: 66.7692(217/325) 68.2390(217/318) 67.4961
LEVEL 6: 66.7692(217/325) 68.2390(217/318) 67.4961
LEVEL 7: 66.4615(216/325) 67.9245(216/318) 67.1851
test.place-benchmark (corpus.KT0.mc):
precision recall F
LEVEL 0: 100.0000(86/86) 100.0000(86/86) 100.0000
LEVEL 1: 89.5349(77/86) 89.5349(77/86) 89.5349
LEVEL 2: 88.3721(76/86) 88.3721(76/86) 88.3721
LEVEL 3: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 4: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 5: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 6: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 7: 81.3953(70/86) 81.3953(70/86) 81.3953
test.non-KT (corpus.KT0.mc):
precision recall F
LEVEL 0: 93.8865(430/458) 93.4783(430/460) 93.6819
LEVEL 1: 84.0611(385/458) 83.6957(385/460) 83.8780
LEVEL 2: 82.7511(379/458) 82.3913(379/460) 82.5708
LEVEL 3: 72.7074(333/458) 72.3913(333/460) 72.5490
LEVEL 4: 67.6856(310/458) 67.3913(310/460) 67.5381
LEVEL 5: 67.6856(310/458) 67.3913(310/460) 67.5381
LEVEL 6: 67.6856(310/458) 67.3913(310/460) 67.5381
LEVEL 7: 66.8122(306/458) 66.5217(306/460) 66.6667
test.mixed (corpus.KT0.mc):
precision recall F
LEVEL 0: 96.0821(6597/6866) 97.6465(6597/6756) 96.8580
LEVEL 1: 94.6257(6497/6866) 96.1664(6497/6756) 95.3898
LEVEL 2: 94.1451(6464/6866) 95.6779(6464/6756) 94.9053
LEVEL 3: 92.1352(6326/6866) 93.6353(6326/6756) 92.8792
LEVEL 4: 90.8389(6237/6866) 92.3179(6237/6756) 91.5725
LEVEL 5: 90.8389(6237/6866) 92.3179(6237/6756) 91.5725
LEVEL 6: 90.8389(6237/6866) 92.3179(6237/6756) 91.5725
LEVEL 7: 90.5913(6220/6866) 92.0663(6220/6756) 91.3229
test.all (corpus.KT0.mc):
precision recall F
LEVEL 0: 78.8087(75338/95596) 86.5695(75338/87026) 82.5070
LEVEL 1: 73.2374(70012/95596) 80.4495(70012/87026) 76.6742
LEVEL 2: 71.9225(68755/95596) 79.0051(68755/87026) 75.2976
LEVEL 3: 65.2737(62399/95596) 71.7016(62399/87026) 68.3368
LEVEL 4: 61.8603(59136/95596) 67.9521(59136/87026) 64.7633
LEVEL 5: 61.8603(59136/95596) 67.9521(59136/87026) 64.7633
LEVEL 6: 61.8603(59136/95596) 67.9521(59136/87026) 64.7633
LEVEL 7: 61.6940(58977/95596) 67.7694(58977/87026) 64.5892
test.KT0 (corpus.KT2.mc):
precision recall F
LEVEL 0: 78.5014(73767/93969) 85.2147(73767/86566) 81.7204
LEVEL 1: 72.0940(67746/93969) 78.2594(67746/86566) 75.0503
LEVEL 2: 69.8507(65638/93969) 75.8242(65638/86566) 72.7150
LEVEL 3: 62.6856(58905/93969) 68.0463(58905/86566) 65.2560
LEVEL 4: 59.2993(55723/93969) 64.3705(55723/86566) 61.7310
LEVEL 5: 59.2993(55723/93969) 64.3705(55723/86566) 61.7310
LEVEL 6: 59.2993(55723/93969) 64.3705(55723/86566) 61.7310
LEVEL 7: 59.1440(55577/93969) 64.2019(55577/86566) 61.5692
test.KT2 (corpus.KT2.mc):
precision recall F
LEVEL 0: 96.3183(6174/6410) 98.0623(6174/6296) 97.1824
LEVEL 1: 95.8814(6146/6410) 97.6175(6146/6296) 96.7417
LEVEL 2: 95.7254(6136/6410) 97.4587(6136/6296) 96.5843
LEVEL 3: 94.6178(6065/6410) 96.3310(6065/6296) 95.4667
LEVEL 4: 94.1342(6034/6410) 95.8386(6034/6296) 94.9788
LEVEL 5: 94.1342(6034/6410) 95.8386(6034/6296) 94.9788
LEVEL 6: 94.1342(6034/6410) 95.8386(6034/6296) 94.9788
LEVEL 7: 93.9158(6020/6410) 95.6163(6020/6296) 94.7584
test.misc (corpus.KT2.mc):
precision recall F
LEVEL 0: 95.5882(65/68) 90.2778(65/72) 92.8571
LEVEL 1: 92.6471(63/68) 87.5000(63/72) 90.0000
LEVEL 2: 92.6471(63/68) 87.5000(63/72) 90.0000
LEVEL 3: 79.4118(54/68) 75.0000(54/72) 77.1429
LEVEL 4: 72.0588(49/68) 68.0556(49/72) 70.0000
LEVEL 5: 72.0588(49/68) 68.0556(49/72) 70.0000
LEVEL 6: 72.0588(49/68) 68.0556(49/72) 70.0000
LEVEL 7: 70.5882(48/68) 66.6667(48/72) 68.5714
test.kanjikai (corpus.KT2.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 83.0508(49/59) 70.0000(49/70) 75.9690
LEVEL 2: 83.0508(49/59) 70.0000(49/70) 75.9690
LEVEL 3: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 4: 57.6271(34/59) 48.5714(34/70) 52.7132
LEVEL 5: 57.6271(34/59) 48.5714(34/70) 52.7132
LEVEL 6: 57.6271(34/59) 48.5714(34/70) 52.7132
LEVEL 7: 55.9322(33/59) 47.1429(33/70) 51.1628
test.ryomou (corpus.KT2.mc):
precision recall F
LEVEL 0: 95.6386(307/321) 96.5409(307/318) 96.0876
LEVEL 1: 82.5545(265/321) 83.3333(265/318) 82.9421
LEVEL 2: 80.3738(258/321) 81.1321(258/318) 80.7512
LEVEL 3: 70.4050(226/321) 71.0692(226/318) 70.7355
LEVEL 4: 63.5514(204/321) 64.1509(204/318) 63.8498
LEVEL 5: 63.5514(204/321) 64.1509(204/318) 63.8498
LEVEL 6: 63.5514(204/321) 64.1509(204/318) 63.8498
LEVEL 7: 63.2399(203/321) 63.8365(203/318) 63.5368
test.place-benchmark (corpus.KT2.mc):
precision recall F
LEVEL 0: 97.5904(81/83) 94.1860(81/86) 95.8580
LEVEL 1: 87.9518(73/83) 84.8837(73/86) 86.3905
LEVEL 2: 85.5422(71/83) 82.5581(71/86) 84.0237
LEVEL 3: 77.1084(64/83) 74.4186(64/86) 75.7396
LEVEL 4: 74.6988(62/83) 72.0930(62/86) 73.3728
LEVEL 5: 74.6988(62/83) 72.0930(62/86) 73.3728
LEVEL 6: 74.6988(62/83) 72.0930(62/86) 73.3728
LEVEL 7: 74.6988(62/83) 72.0930(62/86) 73.3728
test.non-KT (corpus.KT2.mc):
precision recall F
LEVEL 0: 95.0893(426/448) 92.6087(426/460) 93.8326
LEVEL 1: 84.1518(377/448) 81.9565(377/460) 83.0396
LEVEL 2: 82.5893(370/448) 80.4348(370/460) 81.4978
LEVEL 3: 71.2054(319/448) 69.3478(319/460) 70.2643
LEVEL 4: 64.0625(287/448) 62.3913(287/460) 63.2159
LEVEL 5: 64.0625(287/448) 62.3913(287/460) 63.2159
LEVEL 6: 64.0625(287/448) 62.3913(287/460) 63.2159
LEVEL 7: 63.3929(284/448) 61.7391(284/460) 62.5551
test.mixed (corpus.KT2.mc):
precision recall F
LEVEL 0: 96.2380(6600/6858) 97.6909(6600/6756) 96.9590
LEVEL 1: 95.1152(6523/6858) 96.5512(6523/6756) 95.8278
LEVEL 2: 94.8673(6506/6858) 96.2996(6506/6756) 95.5781
LEVEL 3: 93.0884(6384/6858) 94.4938(6384/6756) 93.7858
LEVEL 4: 92.1697(6321/6858) 93.5613(6321/6756) 92.8603
LEVEL 5: 92.1697(6321/6858) 93.5613(6321/6756) 92.8603
LEVEL 6: 92.1697(6321/6858) 93.5613(6321/6756) 92.8603
LEVEL 7: 91.9218(6304/6858) 93.3097(6304/6756) 92.6105
test.all (corpus.KT2.mc):
precision recall F
LEVEL 0: 78.5801(74193/94417) 85.2538(74193/87026) 81.7811
LEVEL 1: 72.1512(68123/94417) 78.2789(68123/87026) 75.0902
LEVEL 2: 69.9111(66008/94417) 75.8486(66008/87026) 72.7589
LEVEL 3: 62.7260(59224/94417) 68.0532(59224/87026) 65.2811
LEVEL 4: 59.3219(56010/94417) 64.3601(56010/87026) 61.7384
LEVEL 5: 59.3219(56010/94417) 64.3601(56010/87026) 61.7384
LEVEL 6: 59.3219(56010/94417) 64.3601(56010/87026) 61.7384
LEVEL 7: 59.1641(55861/94417) 64.1889(55861/87026) 61.5742
test.KT0 (corpus.misc.mc):
precision recall F
LEVEL 0: 76.4015(72424/94794) 83.6633(72424/86566) 79.8677
LEVEL 1: 65.9546(62521/94794) 72.2235(62521/86566) 68.9468
LEVEL 2: 61.2096(58023/94794) 67.0275(58023/86566) 63.9865
LEVEL 3: 52.3883(49661/94794) 57.3678(49661/86566) 54.7651
LEVEL 4: 48.3828(45864/94794) 52.9815(45864/86566) 50.5779
LEVEL 5: 48.3828(45864/94794) 52.9815(45864/86566) 50.5779
LEVEL 6: 48.3828(45864/94794) 52.9815(45864/86566) 50.5779
LEVEL 7: 48.2277(45717/94794) 52.8117(45717/86566) 50.4157
test.KT2 (corpus.misc.mc):
precision recall F
LEVEL 0: 90.4311(5916/6542) 93.9644(5916/6296) 92.1639
LEVEL 1: 81.3513(5322/6542) 84.5299(5322/6296) 82.9101
LEVEL 2: 76.9948(5037/6542) 80.0032(5037/6296) 78.4702
LEVEL 3: 71.1709(4656/6542) 73.9517(4656/6296) 72.5347
LEVEL 4: 68.0679(4453/6542) 70.7274(4453/6296) 69.3722
LEVEL 5: 68.0679(4453/6542) 70.7274(4453/6296) 69.3722
LEVEL 6: 68.0679(4453/6542) 70.7274(4453/6296) 69.3722
LEVEL 7: 67.8692(4440/6542) 70.5210(4440/6296) 69.1697
test.misc (corpus.misc.mc):
precision recall F
LEVEL 0: 100.0000(72/72) 100.0000(72/72) 100.0000
LEVEL 1: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 2: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 3: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 4: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 5: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 6: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 7: 80.5556(58/72) 80.5556(58/72) 80.5556
test.kanjikai (corpus.misc.mc):
precision recall F
LEVEL 0: 87.5000(49/56) 70.0000(49/70) 77.7778
LEVEL 1: 71.4286(40/56) 57.1429(40/70) 63.4921
LEVEL 2: 69.6429(39/56) 55.7143(39/70) 61.9048
LEVEL 3: 58.9286(33/56) 47.1429(33/70) 52.3810
LEVEL 4: 48.2143(27/56) 38.5714(27/70) 42.8571
LEVEL 5: 48.2143(27/56) 38.5714(27/70) 42.8571
LEVEL 6: 48.2143(27/56) 38.5714(27/70) 42.8571
LEVEL 7: 48.2143(27/56) 38.5714(27/70) 42.8571
test.ryomou (corpus.misc.mc):
precision recall F
LEVEL 0: 92.5926(300/324) 94.3396(300/318) 93.4579
LEVEL 1: 75.0000(243/324) 76.4151(243/318) 75.7009
LEVEL 2: 70.9877(230/324) 72.3270(230/318) 71.6511
LEVEL 3: 61.7284(200/324) 62.8931(200/318) 62.3053
LEVEL 4: 55.5556(180/324) 56.6038(180/318) 56.0748
LEVEL 5: 55.5556(180/324) 56.6038(180/318) 56.0748
LEVEL 6: 55.5556(180/324) 56.6038(180/318) 56.0748
LEVEL 7: 55.2469(179/324) 56.2893(179/318) 55.7632
test.place-benchmark (corpus.misc.mc):
precision recall F
LEVEL 0: 95.0617(77/81) 89.5349(77/86) 92.2156
LEVEL 1: 86.4198(70/81) 81.3953(70/86) 83.8323
LEVEL 2: 79.0123(64/81) 74.4186(64/86) 76.6467
LEVEL 3: 71.6049(58/81) 67.4419(58/86) 69.4611
LEVEL 4: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 5: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 6: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 7: 65.4321(53/81) 61.6279(53/86) 63.4731
test.non-KT (corpus.misc.mc):
precision recall F
LEVEL 0: 93.1416(421/452) 91.5217(421/460) 92.3246
LEVEL 1: 78.0973(353/452) 76.7391(353/460) 77.4123
LEVEL 2: 75.0000(339/452) 73.6957(339/460) 74.3421
LEVEL 3: 65.7080(297/452) 64.5652(297/460) 65.1316
LEVEL 4: 59.0708(267/452) 58.0435(267/460) 58.5526
LEVEL 5: 59.0708(267/452) 58.0435(267/460) 58.5526
LEVEL 6: 59.0708(267/452) 58.0435(267/460) 58.5526
LEVEL 7: 58.4071(264/452) 57.3913(264/460) 57.8947
test.mixed (corpus.misc.mc):
precision recall F
LEVEL 0: 90.6062(6337/6994) 93.7981(6337/6756) 92.1745
LEVEL 1: 81.1410(5675/6994) 83.9994(5675/6756) 82.5455
LEVEL 2: 76.8659(5376/6994) 79.5737(5376/6756) 78.1964
LEVEL 3: 70.8178(4953/6994) 73.3126(4953/6756) 72.0436
LEVEL 4: 67.4864(4720/6994) 69.8638(4720/6756) 68.6545
LEVEL 5: 67.4864(4720/6994) 69.8638(4720/6756) 68.6545
LEVEL 6: 67.4864(4720/6994) 69.8638(4720/6756) 68.6545
LEVEL 7: 67.2576(4704/6994) 69.6270(4704/6756) 68.4218
test.all (corpus.misc.mc):
precision recall F
LEVEL 0: 76.4809(72845/95246) 83.7049(72845/87026) 79.9300
LEVEL 1: 66.0122(62874/95246) 72.2474(62874/87026) 68.9892
LEVEL 2: 61.2750(58362/95246) 67.0627(58362/87026) 64.0384
LEVEL 3: 52.4515(49958/95246) 57.4058(49958/87026) 54.8170
LEVEL 4: 48.4335(46131/95246) 53.0083(46131/87026) 50.6178
LEVEL 5: 48.4335(46131/95246) 53.0083(46131/87026) 50.6178
LEVEL 6: 48.4335(46131/95246) 53.0083(46131/87026) 50.6178
LEVEL 7: 48.2760(45981/95246) 52.8359(45981/87026) 50.4532
test.KT0 (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 76.5471(72347/94513) 83.5744(72347/86566) 79.9066
LEVEL 1: 65.2683(61687/94513) 71.2601(61687/86566) 68.1327
LEVEL 2: 60.7906(57455/94513) 66.3713(57455/86566) 63.4585
LEVEL 3: 51.0067(48208/94513) 55.6893(48208/86566) 53.2453
LEVEL 4: 47.3797(44780/94513) 51.7293(44780/86566) 49.4591
LEVEL 5: 47.3797(44780/94513) 51.7293(44780/86566) 49.4591
LEVEL 6: 47.3797(44780/94513) 51.7293(44780/86566) 49.4591
LEVEL 7: 47.2686(44675/94513) 51.6080(44675/86566) 49.3431
test.KT2 (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 91.8330(5982/6514) 95.0127(5982/6296) 93.3958
LEVEL 1: 83.0212(5408/6514) 85.8958(5408/6296) 84.4340
LEVEL 2: 78.3083(5101/6514) 81.0197(5101/6296) 79.6409
LEVEL 3: 72.9966(4755/6514) 75.5241(4755/6296) 74.2389
LEVEL 4: 70.3101(4580/6514) 72.7446(4580/6296) 71.5066
LEVEL 5: 70.3101(4580/6514) 72.7446(4580/6296) 71.5066
LEVEL 6: 70.3101(4580/6514) 72.7446(4580/6296) 71.5066
LEVEL 7: 70.1105(4567/6514) 72.5381(4567/6296) 71.3037
test.misc (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 90.0000(63/70) 87.5000(63/72) 88.7324
LEVEL 1: 82.8571(58/70) 80.5556(58/72) 81.6901
LEVEL 2: 80.0000(56/70) 77.7778(56/72) 78.8732
LEVEL 3: 65.7143(46/70) 63.8889(46/72) 64.7887
LEVEL 4: 62.8571(44/70) 61.1111(44/72) 61.9718
LEVEL 5: 62.8571(44/70) 61.1111(44/72) 61.9718
LEVEL 6: 62.8571(44/70) 61.1111(44/72) 61.9718
LEVEL 7: 61.4286(43/70) 59.7222(43/72) 60.5634
test.kanjikai (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 93.3333(56/60) 80.0000(56/70) 86.1538
LEVEL 1: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 2: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 3: 78.3333(47/60) 67.1429(47/70) 72.3077
LEVEL 4: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 5: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 6: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 7: 68.3333(41/60) 58.5714(41/70) 63.0769
test.ryomou (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 94.0625(301/320) 94.6541(301/318) 94.3574
LEVEL 1: 75.9375(243/320) 76.4151(243/318) 76.1755
LEVEL 2: 71.5625(229/320) 72.0126(229/318) 71.7868
LEVEL 3: 59.0625(189/320) 59.4340(189/318) 59.2476
LEVEL 4: 52.1875(167/320) 52.5157(167/318) 52.3511
LEVEL 5: 52.1875(167/320) 52.5157(167/318) 52.3511
LEVEL 6: 52.1875(167/320) 52.5157(167/318) 52.3511
LEVEL 7: 51.8750(166/320) 52.2013(166/318) 52.0376
test.place-benchmark (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 95.0617(77/81) 89.5349(77/86) 92.2156
LEVEL 1: 81.4815(66/81) 76.7442(66/86) 79.0419
LEVEL 2: 77.7778(63/81) 73.2558(63/86) 75.4491
LEVEL 3: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 4: 61.7284(50/81) 58.1395(50/86) 59.8802
LEVEL 5: 61.7284(50/81) 58.1395(50/86) 59.8802
LEVEL 6: 61.7284(50/81) 58.1395(50/86) 59.8802
LEVEL 7: 61.7284(50/81) 58.1395(50/86) 59.8802
test.non-KT (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 93.3333(420/450) 91.3043(420/460) 92.3077
LEVEL 1: 78.6667(354/450) 76.9565(354/460) 77.8022
LEVEL 2: 75.1111(338/450) 73.4783(338/460) 74.2857
LEVEL 3: 62.6667(282/450) 61.3043(282/460) 61.9780
LEVEL 4: 56.2222(253/450) 55.0000(253/460) 55.6044
LEVEL 5: 56.2222(253/450) 55.0000(253/460) 55.6044
LEVEL 6: 56.2222(253/450) 55.0000(253/460) 55.6044
LEVEL 7: 55.5556(250/450) 54.3478(250/460) 54.9451
test.mixed (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 91.9299(6402/6964) 94.7602(6402/6756) 93.3236
LEVEL 1: 82.7398(5762/6964) 85.2872(5762/6756) 83.9942
LEVEL 2: 78.1017(5439/6964) 80.5062(5439/6756) 79.2857
LEVEL 3: 72.3291(5037/6964) 74.5560(5037/6756) 73.4257
LEVEL 4: 69.3998(4833/6964) 71.5364(4833/6756) 70.4519
LEVEL 5: 69.3998(4833/6964) 71.5364(4833/6756) 70.4519
LEVEL 6: 69.3998(4833/6964) 71.5364(4833/6756) 70.4519
LEVEL 7: 69.1700(4817/6964) 71.2996(4817/6756) 70.2187
test.all (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 76.6267(72767/94963) 83.6152(72767/87026) 79.9686
LEVEL 1: 65.3318(62041/94963) 71.2902(62041/87026) 68.1810
LEVEL 2: 60.8584(57793/94963) 66.4089(57793/87026) 63.5126
LEVEL 3: 51.0620(48490/94963) 55.7190(48490/87026) 53.2889
LEVEL 4: 47.4216(45033/94963) 51.7466(45033/87026) 49.4898
LEVEL 5: 47.4216(45033/94963) 51.7466(45033/87026) 49.4898
LEVEL 6: 47.4216(45033/94963) 51.7466(45033/87026) 49.4898
LEVEL 7: 47.3079(44925/94963) 51.6225(44925/87026) 49.3711
test.KT0 (corpus.ryomou.mc):
precision recall F
LEVEL 0: 77.6119(72467/93371) 83.7130(72467/86566) 80.5471
LEVEL 1: 67.8776(63378/93371) 73.2135(63378/86566) 70.4447
LEVEL 2: 64.1023(59853/93371) 69.1415(59853/86566) 66.5266
LEVEL 3: 55.2698(51606/93371) 59.6146(51606/86566) 57.3601
LEVEL 4: 50.9741(47595/93371) 54.9812(47595/86566) 52.9018
LEVEL 5: 50.9741(47595/93371) 54.9812(47595/86566) 52.9018
LEVEL 6: 50.9741(47595/93371) 54.9812(47595/86566) 52.9018
LEVEL 7: 50.8381(47468/93371) 54.8345(47468/86566) 52.7607
test.KT2 (corpus.ryomou.mc):
precision recall F
LEVEL 0: 94.9230(6039/6362) 95.9180(6039/6296) 95.4179
LEVEL 1: 88.7928(5649/6362) 89.7236(5649/6296) 89.2558
LEVEL 2: 85.8221(5460/6362) 86.7217(5460/6296) 86.2696
LEVEL 3: 81.4052(5179/6362) 82.2586(5179/6296) 81.8297
LEVEL 4: 78.4030(4988/6362) 79.2249(4988/6296) 78.8118
LEVEL 5: 78.4030(4988/6362) 79.2249(4988/6296) 78.8118
LEVEL 6: 78.4030(4988/6362) 79.2249(4988/6296) 78.8118
LEVEL 7: 78.2144(4976/6362) 79.0343(4976/6296) 78.6222
test.misc (corpus.ryomou.mc):
precision recall F
LEVEL 0: 92.7536(64/69) 88.8889(64/72) 90.7801
LEVEL 1: 85.5072(59/69) 81.9444(59/72) 83.6879
LEVEL 2: 84.0580(58/69) 80.5556(58/72) 82.2695
LEVEL 3: 71.0145(49/69) 68.0556(49/72) 69.5035
LEVEL 4: 65.2174(45/69) 62.5000(45/72) 63.8298
LEVEL 5: 65.2174(45/69) 62.5000(45/72) 63.8298
LEVEL 6: 65.2174(45/69) 62.5000(45/72) 63.8298
LEVEL 7: 62.3188(43/69) 59.7222(43/72) 60.9929
test.kanjikai (corpus.ryomou.mc):
precision recall F
LEVEL 0: 89.4737(51/57) 72.8571(51/70) 80.3150
LEVEL 1: 75.4386(43/57) 61.4286(43/70) 67.7165
LEVEL 2: 75.4386(43/57) 61.4286(43/70) 67.7165
LEVEL 3: 56.1404(32/57) 45.7143(32/70) 50.3937
LEVEL 4: 42.1053(24/57) 34.2857(24/70) 37.7953
LEVEL 5: 42.1053(24/57) 34.2857(24/70) 37.7953
LEVEL 6: 42.1053(24/57) 34.2857(24/70) 37.7953
LEVEL 7: 42.1053(24/57) 34.2857(24/70) 37.7953
test.ryomou (corpus.ryomou.mc):
precision recall F
LEVEL 0: 96.2848(311/323) 97.7987(311/318) 97.0359
LEVEL 1: 86.3777(279/323) 87.7358(279/318) 87.0515
LEVEL 2: 84.8297(274/323) 86.1635(274/318) 85.4914
LEVEL 3: 76.1610(246/323) 77.3585(246/318) 76.7551
LEVEL 4: 69.9690(226/323) 71.0692(226/318) 70.5148
LEVEL 5: 69.9690(226/323) 71.0692(226/318) 70.5148
LEVEL 6: 69.9690(226/323) 71.0692(226/318) 70.5148
LEVEL 7: 69.6594(225/323) 70.7547(225/318) 70.2028
test.place-benchmark (corpus.ryomou.mc):
precision recall F
LEVEL 0: 96.3415(79/82) 91.8605(79/86) 94.0476
LEVEL 1: 85.3659(70/82) 81.3953(70/86) 83.3333
LEVEL 2: 81.7073(67/82) 77.9070(67/86) 79.7619
LEVEL 3: 68.2927(56/82) 65.1163(56/86) 66.6667
LEVEL 4: 68.2927(56/82) 65.1163(56/86) 66.6667
LEVEL 5: 68.2927(56/82) 65.1163(56/86) 66.6667
LEVEL 6: 68.2927(56/82) 65.1163(56/86) 66.6667
LEVEL 7: 68.2927(56/82) 65.1163(56/86) 66.6667
test.non-KT (corpus.ryomou.mc):
precision recall F
LEVEL 0: 94.8775(426/449) 92.6087(426/460) 93.7294
LEVEL 1: 84.8552(381/449) 82.8261(381/460) 83.8284
LEVEL 2: 83.5189(375/449) 81.5217(375/460) 82.5083
LEVEL 3: 72.8285(327/449) 71.0870(327/460) 71.9472
LEVEL 4: 65.7016(295/449) 64.1304(295/460) 64.9065
LEVEL 5: 65.7016(295/449) 64.1304(295/460) 64.9065
LEVEL 6: 65.7016(295/449) 64.1304(295/460) 64.9065
LEVEL 7: 65.0334(292/449) 63.4783(292/460) 64.2464
test.mixed (corpus.ryomou.mc):
precision recall F
LEVEL 0: 94.9200(6465/6811) 95.6927(6465/6756) 95.3048
LEVEL 1: 88.5333(6030/6811) 89.2540(6030/6756) 88.8922
LEVEL 2: 85.6702(5835/6811) 86.3677(5835/6756) 86.0175
LEVEL 3: 80.8398(5506/6811) 81.4979(5506/6756) 81.1675
LEVEL 4: 77.5657(5283/6811) 78.1972(5283/6756) 77.8802
LEVEL 5: 77.5657(5283/6811) 78.1972(5283/6756) 77.8802
LEVEL 6: 77.5657(5283/6811) 78.1972(5283/6756) 77.8802
LEVEL 7: 77.3455(5268/6811) 77.9751(5268/6756) 77.6590
test.all (corpus.ryomou.mc):
precision recall F
LEVEL 0: 77.6945(72893/93820) 83.7600(72893/87026) 80.6133
LEVEL 1: 67.9589(63759/93820) 73.2643(63759/87026) 70.5119
LEVEL 2: 64.1953(60228/93820) 69.2069(60228/87026) 66.6069
LEVEL 3: 55.3539(51933/93820) 59.6753(51933/87026) 57.4334
LEVEL 4: 51.0446(47890/93820) 55.0295(47890/87026) 52.9622
LEVEL 5: 51.0446(47890/93820) 55.0295(47890/87026) 52.9622
LEVEL 6: 51.0446(47890/93820) 55.0295(47890/87026) 52.9622
LEVEL 7: 50.9060(47760/93820) 54.8802(47760/87026) 52.8184
test.KT0 (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 75.0716(72363/96392) 83.5929(72363/86566) 79.1034
LEVEL 1: 65.0178(62672/96392) 72.3979(62672/86566) 68.5097
LEVEL 2: 61.6981(59472/96392) 68.7013(59472/86566) 65.0116
LEVEL 3: 52.7668(50863/96392) 58.7563(50863/86566) 55.6007
LEVEL 4: 48.4812(46732/96392) 53.9842(46732/86566) 51.0849
LEVEL 5: 48.4812(46732/96392) 53.9842(46732/86566) 51.0849
LEVEL 6: 48.4812(46732/96392) 53.9842(46732/86566) 51.0849
LEVEL 7: 48.3577(46613/96392) 53.8468(46613/86566) 50.9549
test.KT2 (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 88.0438(5869/6666) 93.2179(5869/6296) 90.5570
LEVEL 1: 80.0930(5339/6666) 84.7999(5339/6296) 82.3793
LEVEL 2: 77.1527(5143/6666) 81.6868(5143/6296) 79.3550
LEVEL 3: 72.7423(4849/6666) 77.0172(4849/6296) 74.8187
LEVEL 4: 68.9319(4595/6666) 72.9828(4595/6296) 70.8996
LEVEL 5: 68.9319(4595/6666) 72.9828(4595/6296) 70.8996
LEVEL 6: 68.9319(4595/6666) 72.9828(4595/6296) 70.8996
LEVEL 7: 68.7519(4583/6666) 72.7922(4583/6296) 70.7144
test.misc (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 1: 81.9444(59/72) 81.9444(59/72) 81.9444
LEVEL 2: 79.1667(57/72) 79.1667(57/72) 79.1667
LEVEL 3: 66.6667(48/72) 66.6667(48/72) 66.6667
LEVEL 4: 62.5000(45/72) 62.5000(45/72) 62.5000
LEVEL 5: 62.5000(45/72) 62.5000(45/72) 62.5000
LEVEL 6: 62.5000(45/72) 62.5000(45/72) 62.5000
LEVEL 7: 61.1111(44/72) 61.1111(44/72) 61.1111
test.kanjikai (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 95.0820(58/61) 82.8571(58/70) 88.5496
LEVEL 1: 83.6066(51/61) 72.8571(51/70) 77.8626
LEVEL 2: 81.9672(50/61) 71.4286(50/70) 76.3359
LEVEL 3: 63.9344(39/61) 55.7143(39/70) 59.5420
LEVEL 4: 49.1803(30/61) 42.8571(30/70) 45.8015
LEVEL 5: 49.1803(30/61) 42.8571(30/70) 45.8015
LEVEL 6: 49.1803(30/61) 42.8571(30/70) 45.8015
LEVEL 7: 47.5410(29/61) 41.4286(29/70) 44.2748
test.ryomou (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 90.8815(299/329) 94.0252(299/318) 92.4266
LEVEL 1: 74.7720(246/329) 77.3585(246/318) 76.0433
LEVEL 2: 70.8207(233/329) 73.2704(233/318) 72.0247
LEVEL 3: 59.2705(195/329) 61.3208(195/318) 60.2782
LEVEL 4: 54.4073(179/329) 56.2893(179/318) 55.3323
LEVEL 5: 54.4073(179/329) 56.2893(179/318) 55.3323
LEVEL 6: 54.4073(179/329) 56.2893(179/318) 55.3323
LEVEL 7: 54.1033(178/329) 55.9748(178/318) 55.0232
test.place-benchmark (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 100.0000(86/86) 100.0000(86/86) 100.0000
LEVEL 1: 94.1860(81/86) 94.1860(81/86) 94.1860
LEVEL 2: 93.0233(80/86) 93.0233(80/86) 93.0233
LEVEL 3: 86.0465(74/86) 86.0465(74/86) 86.0465
LEVEL 4: 82.5581(71/86) 82.5581(71/86) 82.5581
LEVEL 5: 82.5581(71/86) 82.5581(71/86) 82.5581
LEVEL 6: 82.5581(71/86) 82.5581(71/86) 82.5581
LEVEL 7: 82.5581(71/86) 82.5581(71/86) 82.5581
test.non-KT (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 91.1255(421/462) 91.5217(421/460) 91.3232
LEVEL 1: 77.0563(356/462) 77.3913(356/460) 77.2234
LEVEL 2: 73.5931(340/462) 73.9130(340/460) 73.7527
LEVEL 3: 61.0390(282/462) 61.3043(282/460) 61.1714
LEVEL 4: 54.9784(254/462) 55.2174(254/460) 55.0976
LEVEL 5: 54.9784(254/462) 55.2174(254/460) 55.0976
LEVEL 6: 54.9784(254/462) 55.2174(254/460) 55.0976
LEVEL 7: 54.3290(251/462) 54.5652(251/460) 54.4469
test.mixed (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 88.2435(6290/7128) 93.1024(6290/6756) 90.6079
LEVEL 1: 79.8962(5695/7128) 84.2954(5695/6756) 82.0369
LEVEL 2: 76.9220(5483/7128) 81.1575(5483/6756) 78.9830
LEVEL 3: 71.9837(5131/7128) 75.9473(5131/6756) 73.9124
LEVEL 4: 68.0275(4849/7128) 71.7732(4849/6756) 69.8502
LEVEL 5: 68.0275(4849/7128) 71.7732(4849/6756) 69.8502
LEVEL 6: 68.0275(4849/7128) 71.7732(4849/6756) 69.8502
LEVEL 7: 67.8171(4834/7128) 71.5512(4834/6756) 69.6341
test.all (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 75.1482(72784/96854) 83.6348(72784/87026) 79.1647
LEVEL 1: 65.0753(63028/96854) 72.4243(63028/87026) 68.5534
LEVEL 2: 61.7548(59812/96854) 68.7289(59812/87026) 65.0555
LEVEL 3: 52.8063(51145/96854) 58.7698(51145/87026) 55.6287
LEVEL 4: 48.5122(46986/96854) 53.9908(46986/87026) 51.1051
LEVEL 5: 48.5122(46986/96854) 53.9908(46986/87026) 51.1051
LEVEL 6: 48.5122(46986/96854) 53.9908(46986/87026) 51.1051
LEVEL 7: 48.3862(46864/96854) 53.8506(46864/87026) 50.9724
test.KT0 (corpus.non-KT.mc):
precision recall F
LEVEL 0: 77.8210(73470/94409) 84.8717(73470/86566) 81.1935
LEVEL 1: 68.6534(64815/94409) 74.8735(64815/86566) 71.6287
LEVEL 2: 65.0648(61427/94409) 70.9597(61427/86566) 67.8845
LEVEL 3: 56.6281(53462/94409) 61.7587(53462/86566) 59.0822
LEVEL 4: 52.8424(49888/94409) 57.6300(49888/86566) 55.1325
LEVEL 5: 52.8424(49888/94409) 57.6300(49888/86566) 55.1325
LEVEL 6: 52.8424(49888/94409) 57.6300(49888/86566) 55.1325
LEVEL 7: 52.7005(49754/94409) 57.4752(49754/86566) 54.9844
test.KT2 (corpus.non-KT.mc):
precision recall F
LEVEL 0: 94.4816(6078/6433) 96.5375(6078/6296) 95.4985
LEVEL 1: 88.7144(5707/6433) 90.6449(5707/6296) 89.6693
LEVEL 2: 85.7765(5518/6433) 87.6429(5518/6296) 86.6997
LEVEL 3: 81.7037(5256/6433) 83.4816(5256/6296) 82.5831
LEVEL 4: 78.7968(5069/6433) 80.5114(5069/6296) 79.6449
LEVEL 5: 78.7968(5069/6433) 80.5114(5069/6296) 79.6449
LEVEL 6: 78.7968(5069/6433) 80.5114(5069/6296) 79.6449
LEVEL 7: 78.6103(5057/6433) 80.3208(5057/6296) 79.4564
test.misc (corpus.non-KT.mc):
precision recall F
LEVEL 0: 100.0000(72/72) 100.0000(72/72) 100.0000
LEVEL 1: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 2: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 3: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 4: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 5: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 6: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 7: 80.5556(58/72) 80.5556(58/72) 80.5556
test.kanjikai (corpus.non-KT.mc):
precision recall F
LEVEL 0: 93.3333(56/60) 80.0000(56/70) 86.1538
LEVEL 1: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 2: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 3: 78.3333(47/60) 67.1429(47/70) 72.3077
LEVEL 4: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 5: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 6: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 7: 68.3333(41/60) 58.5714(41/70) 63.0769
test.ryomou (corpus.non-KT.mc):
precision recall F
LEVEL 0: 95.0769(309/325) 97.1698(309/318) 96.1120
LEVEL 1: 83.6923(272/325) 85.5346(272/318) 84.6034
LEVEL 2: 81.8462(266/325) 83.6478(266/318) 82.7372
LEVEL 3: 73.8462(240/325) 75.4717(240/318) 74.6501
LEVEL 4: 68.9231(224/325) 70.4403(224/318) 69.6734
LEVEL 5: 68.9231(224/325) 70.4403(224/318) 69.6734
LEVEL 6: 68.9231(224/325) 70.4403(224/318) 69.6734
LEVEL 7: 68.6154(223/325) 70.1258(223/318) 69.3624
test.place-benchmark (corpus.non-KT.mc):
precision recall F
LEVEL 0: 95.0617(77/81) 89.5349(77/86) 92.2156
LEVEL 1: 86.4198(70/81) 81.3953(70/86) 83.8323
LEVEL 2: 82.7160(67/81) 77.9070(67/86) 80.2395
LEVEL 3: 70.3704(57/81) 66.2791(57/86) 68.2635
LEVEL 4: 66.6667(54/81) 62.7907(54/86) 64.6707
LEVEL 5: 66.6667(54/81) 62.7907(54/86) 64.6707
LEVEL 6: 66.6667(54/81) 62.7907(54/86) 64.6707
LEVEL 7: 66.6667(54/81) 62.7907(54/86) 64.6707
test.non-KT (corpus.non-KT.mc):
precision recall F
LEVEL 0: 95.6236(437/457) 95.0000(437/460) 95.3108
LEVEL 1: 86.4333(395/457) 85.8696(395/460) 86.1505
LEVEL 2: 85.1204(389/457) 84.5652(389/460) 84.8419
LEVEL 3: 76.8053(351/457) 76.3043(351/460) 76.5540
LEVEL 4: 71.3348(326/457) 70.8696(326/460) 71.1014
LEVEL 5: 71.3348(326/457) 70.8696(326/460) 71.1014
LEVEL 6: 71.3348(326/457) 70.8696(326/460) 71.1014
LEVEL 7: 70.4595(322/457) 70.0000(322/460) 70.2290
test.mixed (corpus.non-KT.mc):
precision recall F
LEVEL 0: 94.5573(6515/6890) 96.4328(6515/6756) 95.4859
LEVEL 1: 88.5631(6102/6890) 90.3197(6102/6756) 89.4328
LEVEL 2: 85.7329(5907/6890) 87.4334(5907/6756) 86.5748
LEVEL 3: 81.3788(5607/6890) 82.9929(5607/6756) 82.1779
LEVEL 4: 78.3019(5395/6890) 79.8549(5395/6756) 79.0708
LEVEL 5: 78.3019(5395/6890) 79.8549(5395/6756) 79.0708
LEVEL 6: 78.3019(5395/6890) 79.8549(5395/6756) 79.0708
LEVEL 7: 78.0697(5379/6890) 79.6181(5379/6756) 78.8363
test.all (corpus.non-KT.mc):
precision recall F
LEVEL 0: 77.9067(73907/94866) 84.9252(73907/87026) 81.2647
LEVEL 1: 68.7391(65210/94866) 74.9316(65210/87026) 71.7019
LEVEL 2: 65.1614(61816/94866) 71.0316(61816/87026) 67.9700
LEVEL 3: 56.7253(53813/94866) 61.8355(53813/87026) 59.1703
LEVEL 4: 52.9315(50214/94866) 57.7000(50214/87026) 55.2130
LEVEL 5: 52.9315(50214/94866) 57.7000(50214/87026) 55.2130
LEVEL 6: 52.9315(50214/94866) 57.7000(50214/87026) 55.2130
LEVEL 7: 52.7860(50076/94866) 57.5414(50076/87026) 55.0612
test.KT0 (corpus.mixed.mc):
precision recall F
LEVEL 0: 78.5172(73880/94094) 85.3453(73880/86566) 81.7890
LEVEL 1: 72.1204(67861/94094) 78.3922(67861/86566) 75.1257
LEVEL 2: 69.9651(65833/94094) 76.0495(65833/86566) 72.8805
LEVEL 3: 62.7734(59066/94094) 68.2323(59066/86566) 65.3891
LEVEL 4: 59.3959(55888/94094) 64.5611(55888/86566) 61.8709
LEVEL 5: 59.3959(55888/94094) 64.5611(55888/86566) 61.8709
LEVEL 6: 59.3959(55888/94094) 64.5611(55888/86566) 61.8709
LEVEL 7: 59.2408(55742/94094) 64.3925(55742/86566) 61.7093
test.KT2 (corpus.mixed.mc):
precision recall F
LEVEL 0: 96.3344(6176/6411) 98.0940(6176/6296) 97.2063
LEVEL 1: 95.8977(6148/6411) 97.6493(6148/6296) 96.7656
LEVEL 2: 95.7261(6137/6411) 97.4746(6137/6296) 96.5924
LEVEL 3: 94.6342(6067/6411) 96.3628(6067/6296) 95.4907
LEVEL 4: 94.1351(6035/6411) 95.8545(6035/6296) 94.9870
LEVEL 5: 94.1351(6035/6411) 95.8545(6035/6296) 94.9870
LEVEL 6: 94.1351(6035/6411) 95.8545(6035/6296) 94.9870
LEVEL 7: 93.9167(6021/6411) 95.6321(6021/6296) 94.7667
test.misc (corpus.mixed.mc):
precision recall F
LEVEL 0: 100.0000(72/72) 100.0000(72/72) 100.0000
LEVEL 1: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 2: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 3: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 4: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 5: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 6: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 7: 80.5556(58/72) 80.5556(58/72) 80.5556
test.kanjikai (corpus.mixed.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 2: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 3: 76.2712(45/59) 64.2857(45/70) 69.7674
LEVEL 4: 69.4915(41/59) 58.5714(41/70) 63.5659
LEVEL 5: 69.4915(41/59) 58.5714(41/70) 63.5659
LEVEL 6: 69.4915(41/59) 58.5714(41/70) 63.5659
LEVEL 7: 67.7966(40/59) 57.1429(40/70) 62.0155
test.ryomou (corpus.mixed.mc):
precision recall F
LEVEL 0: 96.2848(311/323) 97.7987(311/318) 97.0359
LEVEL 1: 85.7585(277/323) 87.1069(277/318) 86.4275
LEVEL 2: 84.8297(274/323) 86.1635(274/318) 85.4914
LEVEL 3: 74.9226(242/323) 76.1006(242/318) 75.5070
LEVEL 4: 68.7307(222/323) 69.8113(222/318) 69.2668
LEVEL 5: 68.7307(222/323) 69.8113(222/318) 69.2668
LEVEL 6: 68.7307(222/323) 69.8113(222/318) 69.2668
LEVEL 7: 68.4211(221/323) 69.4969(221/318) 68.9548
test.place-benchmark (corpus.mixed.mc):
precision recall F
LEVEL 0: 96.3855(80/83) 93.0233(80/86) 94.6746
LEVEL 1: 86.7470(72/83) 83.7209(72/86) 85.2071
LEVEL 2: 84.3373(70/83) 81.3953(70/86) 82.8402
LEVEL 3: 75.9036(63/83) 73.2558(63/86) 74.5562
LEVEL 4: 73.4940(61/83) 70.9302(61/86) 72.1893
LEVEL 5: 73.4940(61/83) 70.9302(61/86) 72.1893
LEVEL 6: 73.4940(61/83) 70.9302(61/86) 72.1893
LEVEL 7: 73.4940(61/83) 70.9302(61/86) 72.1893
test.non-KT (corpus.mixed.mc):
precision recall F
LEVEL 0: 96.2555(437/454) 95.0000(437/460) 95.6236
LEVEL 1: 87.8855(399/454) 86.7391(399/460) 87.3085
LEVEL 2: 87.2247(396/454) 86.0870(396/460) 86.6521
LEVEL 3: 77.3128(351/454) 76.3043(351/460) 76.8053
LEVEL 4: 71.1454(323/454) 70.2174(323/460) 70.6783
LEVEL 5: 71.1454(323/454) 70.2174(323/460) 70.6783
LEVEL 6: 71.1454(323/454) 70.2174(323/460) 70.6783
LEVEL 7: 70.2643(319/454) 69.3478(319/460) 69.8031
test.mixed (corpus.mixed.mc):
precision recall F
LEVEL 0: 96.3292(6613/6865) 97.8834(6613/6756) 97.1001
LEVEL 1: 95.3678(6547/6865) 96.9065(6547/6756) 96.1310
LEVEL 2: 95.1639(6533/6865) 96.6992(6533/6756) 95.9254
LEVEL 3: 93.4887(6418/6865) 94.9970(6418/6756) 94.2368
LEVEL 4: 92.6147(6358/6865) 94.1089(6358/6756) 93.3558
LEVEL 5: 92.6147(6358/6865) 94.1089(6358/6756) 93.3558
LEVEL 6: 92.6147(6358/6865) 94.1089(6358/6756) 93.3558
LEVEL 7: 92.3525(6340/6865) 93.8425(6340/6756) 93.0915
test.all (corpus.mixed.mc):
precision recall F
LEVEL 0: 78.6024(74317/94548) 85.3963(74317/87026) 81.8586
LEVEL 1: 72.1961(68260/94548) 78.4363(68260/87026) 75.1870
LEVEL 2: 70.0480(66229/94548) 76.1025(66229/87026) 72.9499
LEVEL 3: 62.8432(59417/94548) 68.2750(59417/87026) 65.4466
LEVEL 4: 59.4523(56211/94548) 64.5910(56211/87026) 61.9153
LEVEL 5: 59.4523(56211/94548) 64.5910(56211/87026) 61.9153
LEVEL 6: 59.4523(56211/94548) 64.5910(56211/87026) 61.9153
LEVEL 7: 59.2937(56061/94548) 64.4187(56061/87026) 61.7500
test.KT0 (corpus.all.mc):
precision recall F
LEVEL 0: 78.7214(74894/95138) 86.5166(74894/86566) 82.4352
LEVEL 1: 73.1579(69601/95138) 80.4022(69601/86566) 76.6092
LEVEL 2: 71.8325(68340/95138) 78.9455(68340/86566) 75.2212
LEVEL 3: 65.2084(62038/95138) 71.6655(62038/86566) 68.2847
LEVEL 4: 61.8228(58817/95138) 67.9447(58817/86566) 64.7394
LEVEL 5: 61.8228(58817/95138) 67.9447(58817/86566) 64.7394
LEVEL 6: 61.8228(58817/95138) 67.9447(58817/86566) 64.7394
LEVEL 7: 61.6589(58661/95138) 67.7645(58661/86566) 64.5676
test.KT2 (corpus.all.mc):
precision recall F
LEVEL 0: 96.2391(6167/6408) 97.9511(6167/6296) 97.0875
LEVEL 1: 95.3496(6110/6408) 97.0457(6110/6296) 96.1902
LEVEL 2: 94.9282(6083/6408) 96.6169(6083/6296) 95.7651
LEVEL 3: 93.4769(5990/6408) 95.1398(5990/6296) 94.3010
LEVEL 4: 92.4313(5923/6408) 94.0756(5923/6296) 93.2462
LEVEL 5: 92.4313(5923/6408) 94.0756(5923/6296) 93.2462
LEVEL 6: 92.4313(5923/6408) 94.0756(5923/6296) 93.2462
LEVEL 7: 92.2285(5910/6408) 93.8691(5910/6296) 93.0416
test.misc (corpus.all.mc):
precision recall F
LEVEL 0: 94.5946(70/74) 97.2222(70/72) 95.8904
LEVEL 1: 91.8919(68/74) 94.4444(68/72) 93.1507
LEVEL 2: 90.5405(67/74) 93.0556(67/72) 91.7808
LEVEL 3: 82.4324(61/74) 84.7222(61/72) 83.5616
LEVEL 4: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 5: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 6: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 7: 77.0270(57/74) 79.1667(57/72) 78.0822
test.kanjikai (corpus.all.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 2: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 3: 74.5763(44/59) 62.8571(44/70) 68.2171
LEVEL 4: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 5: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 6: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 7: 64.4068(38/59) 54.2857(38/70) 58.9147
test.ryomou (corpus.all.mc):
precision recall F
LEVEL 0: 94.4785(308/326) 96.8553(308/318) 95.6522
LEVEL 1: 83.1288(271/326) 85.2201(271/318) 84.1615
LEVEL 2: 81.9018(267/326) 83.9623(267/318) 82.9193
LEVEL 3: 72.6994(237/326) 74.5283(237/318) 73.6025
LEVEL 4: 67.7914(221/326) 69.4969(221/318) 68.6335
LEVEL 5: 67.7914(221/326) 69.4969(221/318) 68.6335
LEVEL 6: 67.7914(221/326) 69.4969(221/318) 68.6335
LEVEL 7: 67.4847(220/326) 69.1824(220/318) 68.3230
test.place-benchmark (corpus.all.mc):
precision recall F
LEVEL 0: 100.0000(86/86) 100.0000(86/86) 100.0000
LEVEL 1: 89.5349(77/86) 89.5349(77/86) 89.5349
LEVEL 2: 88.3721(76/86) 88.3721(76/86) 88.3721
LEVEL 3: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 4: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 5: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 6: 81.3953(70/86) 81.3953(70/86) 81.3953
LEVEL 7: 81.3953(70/86) 81.3953(70/86) 81.3953
test.non-KT (corpus.all.mc):
precision recall F
LEVEL 0: 94.1176(432/459) 93.9130(432/460) 94.0152
LEVEL 1: 85.1852(391/459) 85.0000(391/460) 85.0925
LEVEL 2: 84.0959(386/459) 83.9130(386/460) 84.0044
LEVEL 3: 74.5098(342/459) 74.3478(342/460) 74.4287
LEVEL 4: 69.4989(319/459) 69.3478(319/460) 69.4233
LEVEL 5: 69.4989(319/459) 69.3478(319/460) 69.4233
LEVEL 6: 69.4989(319/459) 69.3478(319/460) 69.4233
LEVEL 7: 68.6275(315/459) 68.4783(315/460) 68.5528
test.mixed (corpus.all.mc):
precision recall F
LEVEL 0: 96.0973(6599/6867) 97.6761(6599/6756) 96.8803
LEVEL 1: 94.6702(6501/6867) 96.2256(6501/6756) 95.4415
LEVEL 2: 94.2042(6469/6867) 95.7519(6469/6756) 94.9717
LEVEL 3: 92.2091(6332/6867) 93.7241(6332/6756) 92.9604
LEVEL 4: 90.8985(6242/6867) 92.3919(6242/6756) 91.6391
LEVEL 5: 90.8985(6242/6867) 92.3919(6242/6756) 91.6391
LEVEL 6: 90.8985(6242/6867) 92.3919(6242/6756) 91.6391
LEVEL 7: 90.6509(6225/6867) 92.1403(6225/6756) 91.3896
test.all (corpus.all.mc):
precision recall F
LEVEL 0: 78.7954(75326/95597) 86.5557(75326/87026) 82.4934
LEVEL 1: 73.2157(69992/95597) 80.4265(69992/87026) 76.6519
LEVEL 2: 71.8914(68726/95597) 78.9718(68726/87026) 75.2654
LEVEL 3: 65.2531(62380/95597) 71.6797(62380/87026) 68.3156
LEVEL 4: 61.8597(59136/95597) 67.9521(59136/87026) 64.7629
LEVEL 5: 61.8597(59136/95597) 67.9521(59136/87026) 64.7629
LEVEL 6: 61.8597(59136/95597) 67.9521(59136/87026) 64.7629
LEVEL 7: 61.6923(58976/95597) 67.7683(58976/87026) 64.5877
seed_KTp2a/system-eval.sh 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/system-eval.sh
\ No newline at end of file
seed_KTp2a/unk.def 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/unk.def
\ No newline at end of file
seed_KTp2a/unk.dic 0 → 100644
+ 0
− 0
View file @ 68a9d772
File added
seed_KTp2a/ymzknk.Interjection.csv 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/ymzknk.Interjection.csv
\ No newline at end of file
seed_KTp2a/ymzknk.Numeral.60.csv 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed-src/ymzknk.Numeral.60.csv
\ No newline at end of file
seed_KTp2a/ymzknk.Numeral.csv 0 → 120000
+ 1
− 0
View file @ 68a9d772
../seed/ymzknk.Numeral.csv
\ No newline at end of file
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment