Skip to content
Snippets Groups Projects
Commit 68543c74 authored by MORIOKA Tomohiko's avatar MORIOKA Tomohiko
Browse files

New files.

parent 68a9d772
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 86736 additions and 0 deletions
seed_KTp2c/matrix.def 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/matrix.def
\ No newline at end of file
seed_KTp2c/mk-final.sh 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/mk-final.sh
\ No newline at end of file
seed_KTp2c/model 0 → 100644
+ 85836
− 0
View file @ 68543c74
Source diff could not be displayed: it is too large. Options to address this: view the blob.
seed_KTp2c/rewrite.def 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/rewrite.def
\ No newline at end of file
seed_KTp2c/sys.dic 0 → 100644
+ 0
− 0
View file @ 68543c74
File added
seed_KTp2c/system-eval.results 0 → 100644
+ 892
− 0
View file @ 68543c74
mecab-system-eval -l "0 1 2 3 4 5 6 7"
test.KT0 (corpus.KT0.mc):
precision recall F
LEVEL 0: 78.1022(74529/95425) 86.0950(74529/86566) 81.9041
LEVEL 1: 72.5669(69247/95425) 79.9933(69247/86566) 76.0994
LEVEL 2: 71.2392(67980/95425) 78.5297(67980/86566) 74.7070
LEVEL 3: 64.5868(61632/95425) 71.1965(61632/86566) 67.7308
LEVEL 4: 61.1999(58400/95425) 67.4630(58400/86566) 64.1790
LEVEL 5: 61.1999(58400/95425) 67.4630(58400/86566) 64.1790
LEVEL 6: 61.1999(58400/95425) 67.4630(58400/86566) 64.1790
LEVEL 7: 61.0595(58266/95425) 67.3082(58266/86566) 64.0317
test.KT2 (corpus.KT0.mc):
precision recall F
LEVEL 0: 95.5677(6145/6430) 97.6017(6145/6296) 96.5739
LEVEL 1: 94.6967(6089/6430) 96.7122(6089/6296) 95.6939
LEVEL 2: 94.2457(6060/6430) 96.2516(6060/6296) 95.2381
LEVEL 3: 92.6905(5960/6430) 94.6633(5960/6296) 93.6665
LEVEL 4: 91.6330(5892/6430) 93.5832(5892/6296) 92.5978
LEVEL 5: 91.6330(5892/6430) 93.5832(5892/6296) 92.5978
LEVEL 6: 91.6330(5892/6430) 93.5832(5892/6296) 92.5978
LEVEL 7: 91.4308(5879/6430) 93.3767(5879/6296) 92.3935
test.misc (corpus.KT0.mc):
precision recall F
LEVEL 0: 94.5946(70/74) 97.2222(70/72) 95.8904
LEVEL 1: 91.8919(68/74) 94.4444(68/72) 93.1507
LEVEL 2: 89.1892(66/74) 91.6667(66/72) 90.4110
LEVEL 3: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 4: 77.0270(57/74) 79.1667(57/72) 78.0822
LEVEL 5: 77.0270(57/74) 79.1667(57/72) 78.0822
LEVEL 6: 77.0270(57/74) 79.1667(57/72) 78.0822
LEVEL 7: 74.3243(55/74) 76.3889(55/72) 75.3425
test.kanjikai (corpus.KT0.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 84.7458(50/59) 71.4286(50/70) 77.5194
LEVEL 2: 84.7458(50/59) 71.4286(50/70) 77.5194
LEVEL 3: 71.1864(42/59) 60.0000(42/70) 65.1163
LEVEL 4: 61.0169(36/59) 51.4286(36/70) 55.8140
LEVEL 5: 61.0169(36/59) 51.4286(36/70) 55.8140
LEVEL 6: 61.0169(36/59) 51.4286(36/70) 55.8140
LEVEL 7: 59.3220(35/59) 50.0000(35/70) 54.2636
test.ryomou (corpus.KT0.mc):
precision recall F
LEVEL 0: 92.3780(303/328) 95.2830(303/318) 93.8080
LEVEL 1: 79.8780(262/328) 82.3899(262/318) 81.1146
LEVEL 2: 78.6585(258/328) 81.1321(258/318) 79.8762
LEVEL 3: 69.2073(227/328) 71.3836(227/318) 70.2786
LEVEL 4: 64.6341(212/328) 66.6667(212/318) 65.6347
LEVEL 5: 64.6341(212/328) 66.6667(212/318) 65.6347
LEVEL 6: 64.6341(212/328) 66.6667(212/318) 65.6347
LEVEL 7: 64.3293(211/328) 66.3522(211/318) 65.3251
test.place-benchmark (corpus.KT0.mc):
precision recall F
LEVEL 0: 100.0000(86/86) 100.0000(86/86) 100.0000
LEVEL 1: 89.5349(77/86) 89.5349(77/86) 89.5349
LEVEL 2: 88.3721(76/86) 88.3721(76/86) 88.3721
LEVEL 3: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 4: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 5: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 6: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 7: 79.0698(68/86) 79.0698(68/86) 79.0698
test.non-KT (corpus.KT0.mc):
precision recall F
LEVEL 0: 92.6247(427/461) 92.8261(427/460) 92.7253
LEVEL 1: 82.4295(380/461) 82.6087(380/460) 82.5190
LEVEL 2: 81.1280(374/461) 81.3043(374/460) 81.2161
LEVEL 3: 71.1497(328/461) 71.3043(328/460) 71.2269
LEVEL 4: 66.1605(305/461) 66.3043(305/460) 66.2324
LEVEL 5: 66.1605(305/461) 66.3043(305/460) 66.2324
LEVEL 6: 66.1605(305/461) 66.3043(305/460) 66.2324
LEVEL 7: 65.2928(301/461) 65.4348(301/460) 65.3637
test.mixed (corpus.KT0.mc):
precision recall F
LEVEL 0: 95.3708(6572/6891) 97.2765(6572/6756) 96.3142
LEVEL 1: 93.8761(6469/6891) 95.7519(6469/6756) 94.8047
LEVEL 2: 93.3682(6434/6891) 95.2339(6434/6756) 94.2918
LEVEL 3: 91.2495(6288/6891) 93.0728(6288/6756) 92.1521
LEVEL 4: 89.9289(6197/6891) 91.7259(6197/6756) 90.8185
LEVEL 5: 89.9289(6197/6891) 91.7259(6197/6756) 90.8185
LEVEL 6: 89.9289(6197/6891) 91.7259(6197/6756) 90.8185
LEVEL 7: 89.6822(6180/6891) 91.4742(6180/6756) 90.5694
test.all (corpus.KT0.mc):
precision recall F
LEVEL 0: 78.1720(74956/95886) 86.1306(74956/87026) 81.9585
LEVEL 1: 72.6144(69627/95886) 80.0071(69627/87026) 76.1317
LEVEL 2: 71.2867(68354/95886) 78.5443(68354/87026) 74.7398
LEVEL 3: 64.6184(61960/95886) 71.1971(61960/87026) 67.7484
LEVEL 4: 61.2237(58705/95886) 67.4569(58705/87026) 64.1893
LEVEL 5: 61.2237(58705/95886) 67.4569(58705/87026) 64.1893
LEVEL 6: 61.2237(58705/95886) 67.4569(58705/87026) 64.1893
LEVEL 7: 61.0798(58567/95886) 67.2983(58567/87026) 64.0384
test.KT0 (corpus.KT2.mc):
precision recall F
LEVEL 0: 77.9229(73461/94274) 84.8613(73461/86566) 81.2442
LEVEL 1: 71.5096(67415/94274) 77.8770(67415/86566) 74.5576
LEVEL 2: 69.2683(65302/94274) 75.4361(65302/86566) 72.2207
LEVEL 3: 62.0553(58502/94274) 67.5808(58502/86566) 64.7003
LEVEL 4: 58.6705(55311/94274) 63.8946(55311/86566) 61.1712
LEVEL 5: 58.6705(55311/94274) 63.8946(55311/86566) 61.1712
LEVEL 6: 58.6705(55311/94274) 63.8946(55311/86566) 61.1712
LEVEL 7: 58.5389(55187/94274) 63.7514(55187/86566) 61.0341
test.KT2 (corpus.KT2.mc):
precision recall F
LEVEL 0: 95.6468(6152/6432) 97.7128(6152/6296) 96.6688
LEVEL 1: 95.2114(6124/6432) 97.2681(6124/6296) 96.2288
LEVEL 2: 95.0404(6113/6432) 97.0934(6113/6296) 96.0559
LEVEL 3: 93.8277(6035/6432) 95.8545(6035/6296) 94.8303
LEVEL 4: 93.3147(6002/6432) 95.3304(6002/6296) 94.3118
LEVEL 5: 93.3147(6002/6432) 95.3304(6002/6296) 94.3118
LEVEL 6: 93.3147(6002/6432) 95.3304(6002/6296) 94.3118
LEVEL 7: 93.0970(5988/6432) 95.1080(5988/6296) 94.0918
test.misc (corpus.KT2.mc):
precision recall F
LEVEL 0: 95.5882(65/68) 90.2778(65/72) 92.8571
LEVEL 1: 92.6471(63/68) 87.5000(63/72) 90.0000
LEVEL 2: 92.6471(63/68) 87.5000(63/72) 90.0000
LEVEL 3: 79.4118(54/68) 75.0000(54/72) 77.1429
LEVEL 4: 72.0588(49/68) 68.0556(49/72) 70.0000
LEVEL 5: 72.0588(49/68) 68.0556(49/72) 70.0000
LEVEL 6: 72.0588(49/68) 68.0556(49/72) 70.0000
LEVEL 7: 70.5882(48/68) 66.6667(48/72) 68.5714
test.kanjikai (corpus.KT2.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 83.0508(49/59) 70.0000(49/70) 75.9690
LEVEL 2: 83.0508(49/59) 70.0000(49/70) 75.9690
LEVEL 3: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 4: 57.6271(34/59) 48.5714(34/70) 52.7132
LEVEL 5: 57.6271(34/59) 48.5714(34/70) 52.7132
LEVEL 6: 57.6271(34/59) 48.5714(34/70) 52.7132
LEVEL 7: 55.9322(33/59) 47.1429(33/70) 51.1628
test.ryomou (corpus.KT2.mc):
precision recall F
LEVEL 0: 93.8272(304/324) 95.5975(304/318) 94.7040
LEVEL 1: 80.5556(261/324) 82.0755(261/318) 81.3084
LEVEL 2: 78.3951(254/324) 79.8742(254/318) 79.1277
LEVEL 3: 68.5185(222/324) 69.8113(222/318) 69.1589
LEVEL 4: 61.7284(200/324) 62.8931(200/318) 62.3053
LEVEL 5: 61.7284(200/324) 62.8931(200/318) 62.3053
LEVEL 6: 61.7284(200/324) 62.8931(200/318) 62.3053
LEVEL 7: 61.4198(199/324) 62.5786(199/318) 61.9938
test.place-benchmark (corpus.KT2.mc):
precision recall F
LEVEL 0: 97.5904(81/83) 94.1860(81/86) 95.8580
LEVEL 1: 87.9518(73/83) 84.8837(73/86) 86.3905
LEVEL 2: 85.5422(71/83) 82.5581(71/86) 84.0237
LEVEL 3: 74.6988(62/83) 72.0930(62/86) 73.3728
LEVEL 4: 72.2892(60/83) 69.7674(60/86) 71.0059
LEVEL 5: 72.2892(60/83) 69.7674(60/86) 71.0059
LEVEL 6: 72.2892(60/83) 69.7674(60/86) 71.0059
LEVEL 7: 72.2892(60/83) 69.7674(60/86) 71.0059
test.non-KT (corpus.KT2.mc):
precision recall F
LEVEL 0: 93.7916(423/451) 91.9565(423/460) 92.8650
LEVEL 1: 82.7051(373/451) 81.0870(373/460) 81.8880
LEVEL 2: 81.1530(366/451) 79.5652(366/460) 80.3513
LEVEL 3: 69.8448(315/451) 68.4783(315/460) 69.1548
LEVEL 4: 62.7494(283/451) 61.5217(283/460) 62.1295
LEVEL 5: 62.7494(283/451) 61.5217(283/460) 62.1295
LEVEL 6: 62.7494(283/451) 61.5217(283/460) 62.1295
LEVEL 7: 62.0843(280/451) 60.8696(280/460) 61.4709
test.mixed (corpus.KT2.mc):
precision recall F
LEVEL 0: 95.5252(6575/6883) 97.3209(6575/6756) 96.4147
LEVEL 1: 94.3920(6497/6883) 96.1664(6497/6756) 95.2709
LEVEL 2: 94.1305(6479/6883) 95.8999(6479/6756) 95.0070
LEVEL 3: 92.2563(6350/6883) 93.9905(6350/6756) 93.1153
LEVEL 4: 91.3119(6285/6883) 93.0284(6285/6756) 92.1622
LEVEL 5: 91.3119(6285/6883) 93.0284(6285/6756) 92.1622
LEVEL 6: 91.3119(6285/6883) 93.0284(6285/6756) 92.1622
LEVEL 7: 91.0649(6268/6883) 92.7768(6268/6756) 91.9129
test.all (corpus.KT2.mc):
precision recall F
LEVEL 0: 77.9984(73884/94725) 84.8988(73884/87026) 81.3024
LEVEL 1: 71.5629(67788/94725) 77.8940(67788/87026) 74.5944
LEVEL 2: 69.3249(65668/94725) 75.4579(65668/87026) 72.2615
LEVEL 3: 62.0924(58817/94725) 67.5855(58817/87026) 64.7226
LEVEL 4: 58.6899(55594/94725) 63.8821(55594/87026) 61.1760
LEVEL 5: 58.6899(55594/94725) 63.8821(55594/87026) 61.1760
LEVEL 6: 58.6899(55594/94725) 63.8821(55594/87026) 61.1760
LEVEL 7: 58.5558(55467/94725) 63.7361(55467/87026) 61.0363
test.KT0 (corpus.misc.mc):
precision recall F
LEVEL 0: 75.9809(72216/95045) 83.4231(72216/86566) 79.5282
LEVEL 1: 65.5595(62311/95045) 71.9809(62311/86566) 68.6203
LEVEL 2: 60.8333(57819/95045) 66.7918(57819/86566) 63.6735
LEVEL 3: 52.0396(49461/95045) 57.1368(49461/86566) 54.4692
LEVEL 4: 48.0467(45666/95045) 52.7528(45666/86566) 50.2899
LEVEL 5: 48.0467(45666/95045) 52.7528(45666/86566) 50.2899
LEVEL 6: 48.0467(45666/95045) 52.7528(45666/86566) 50.2899
LEVEL 7: 47.9141(45540/95045) 52.6073(45540/86566) 50.1511
test.KT2 (corpus.misc.mc):
precision recall F
LEVEL 0: 89.9665(5900/6558) 93.7103(5900/6296) 91.8002
LEVEL 1: 80.8936(5305/6558) 84.2598(5305/6296) 82.5424
LEVEL 2: 76.5325(5019/6558) 79.7173(5019/6296) 78.0924
LEVEL 3: 70.7533(4640/6558) 73.6976(4640/6296) 72.1954
LEVEL 4: 67.6578(4437/6558) 70.4733(4437/6296) 69.0369
LEVEL 5: 67.6578(4437/6558) 70.4733(4437/6296) 69.0369
LEVEL 6: 67.6578(4437/6558) 70.4733(4437/6296) 69.0369
LEVEL 7: 67.4596(4424/6558) 70.2668(4424/6296) 68.8346
test.misc (corpus.misc.mc):
precision recall F
LEVEL 0: 100.0000(72/72) 100.0000(72/72) 100.0000
LEVEL 1: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 2: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 3: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 4: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 5: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 6: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 7: 80.5556(58/72) 80.5556(58/72) 80.5556
test.kanjikai (corpus.misc.mc):
precision recall F
LEVEL 0: 87.5000(49/56) 70.0000(49/70) 77.7778
LEVEL 1: 71.4286(40/56) 57.1429(40/70) 63.4921
LEVEL 2: 69.6429(39/56) 55.7143(39/70) 61.9048
LEVEL 3: 58.9286(33/56) 47.1429(33/70) 52.3810
LEVEL 4: 48.2143(27/56) 38.5714(27/70) 42.8571
LEVEL 5: 48.2143(27/56) 38.5714(27/70) 42.8571
LEVEL 6: 48.2143(27/56) 38.5714(27/70) 42.8571
LEVEL 7: 48.2143(27/56) 38.5714(27/70) 42.8571
test.ryomou (corpus.misc.mc):
precision recall F
LEVEL 0: 91.4110(298/326) 93.7107(298/318) 92.5466
LEVEL 1: 73.9264(241/326) 75.7862(241/318) 74.8447
LEVEL 2: 69.9387(228/326) 71.6981(228/318) 70.8075
LEVEL 3: 60.7362(198/326) 62.2642(198/318) 61.4907
LEVEL 4: 54.2945(177/326) 55.6604(177/318) 54.9689
LEVEL 5: 54.2945(177/326) 55.6604(177/318) 54.9689
LEVEL 6: 54.2945(177/326) 55.6604(177/318) 54.9689
LEVEL 7: 53.9877(176/326) 55.3459(176/318) 54.6584
test.place-benchmark (corpus.misc.mc):
precision recall F
LEVEL 0: 95.0617(77/81) 89.5349(77/86) 92.2156
LEVEL 1: 86.4198(70/81) 81.3953(70/86) 83.8323
LEVEL 2: 79.0123(64/81) 74.4186(64/86) 76.6467
LEVEL 3: 69.1358(56/81) 65.1163(56/86) 67.0659
LEVEL 4: 62.9630(51/81) 59.3023(51/86) 61.0778
LEVEL 5: 62.9630(51/81) 59.3023(51/86) 61.0778
LEVEL 6: 62.9630(51/81) 59.3023(51/86) 61.0778
LEVEL 7: 62.9630(51/81) 59.3023(51/86) 61.0778
test.non-KT (corpus.misc.mc):
precision recall F
LEVEL 0: 92.2907(419/454) 91.0870(419/460) 91.6849
LEVEL 1: 77.3128(351/454) 76.3043(351/460) 76.8053
LEVEL 2: 74.2291(337/454) 73.2609(337/460) 73.7418
LEVEL 3: 64.9780(295/454) 64.1304(295/460) 64.5514
LEVEL 4: 58.1498(264/454) 57.3913(264/460) 57.7681
LEVEL 5: 58.1498(264/454) 57.3913(264/460) 57.7681
LEVEL 6: 58.1498(264/454) 57.3913(264/460) 57.7681
LEVEL 7: 57.4890(261/454) 56.7391(261/460) 57.1116
test.mixed (corpus.misc.mc):
precision recall F
LEVEL 0: 90.1169(6319/7012) 93.5317(6319/6756) 91.7926
LEVEL 1: 80.6617(5656/7012) 83.7182(5656/6756) 82.1615
LEVEL 2: 76.3833(5356/7012) 79.2777(5356/6756) 77.8036
LEVEL 3: 70.3793(4935/7012) 73.0462(4935/6756) 71.6880
LEVEL 4: 67.0422(4701/7012) 69.5826(4701/6756) 68.2888
LEVEL 5: 67.0422(4701/7012) 69.5826(4701/6756) 68.2888
LEVEL 6: 67.0422(4701/7012) 69.5826(4701/6756) 68.2888
LEVEL 7: 66.8140(4685/7012) 69.3458(4685/6756) 68.0564
test.all (corpus.misc.mc):
precision recall F
LEVEL 0: 76.0584(72635/95499) 83.4636(72635/87026) 79.5891
LEVEL 1: 65.6153(62662/95499) 72.0038(62662/87026) 68.6613
LEVEL 2: 60.8970(58156/95499) 66.8260(58156/87026) 63.7239
LEVEL 3: 52.1011(49756/95499) 57.1737(49756/87026) 54.5197
LEVEL 4: 48.0947(45930/95499) 52.7773(45930/87026) 50.3274
LEVEL 5: 48.0947(45930/95499) 52.7773(45930/87026) 50.3274
LEVEL 6: 48.0947(45930/95499) 52.7773(45930/87026) 50.3274
LEVEL 7: 47.9597(45801/95499) 52.6291(45801/87026) 50.1860
test.KT0 (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 76.0795(72118/94793) 83.3098(72118/86566) 79.5307
LEVEL 1: 64.8297(61454/94793) 70.9909(61454/86566) 67.7706
LEVEL 2: 60.3642(57221/94793) 66.1010(57221/86566) 63.1025
LEVEL 3: 50.5871(47953/94793) 55.3947(47953/86566) 52.8819
LEVEL 4: 46.9708(44525/94793) 51.4347(44525/86566) 49.1015
LEVEL 5: 46.9708(44525/94793) 51.4347(44525/86566) 49.1015
LEVEL 6: 46.9708(44525/94793) 51.4347(44525/86566) 49.1015
LEVEL 7: 46.8769(44436/94793) 51.3319(44436/86566) 49.0034
test.KT2 (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 91.2751(5963/6533) 94.7109(5963/6296) 92.9613
LEVEL 1: 82.4736(5388/6533) 85.5781(5388/6296) 83.9972
LEVEL 2: 77.7744(5081/6533) 80.7020(5081/6296) 79.2112
LEVEL 3: 72.4476(4733/6533) 75.1747(4733/6296) 73.7860
LEVEL 4: 69.7689(4558/6533) 72.3952(4558/6296) 71.0578
LEVEL 5: 69.7689(4558/6533) 72.3952(4558/6296) 71.0578
LEVEL 6: 69.7689(4558/6533) 72.3952(4558/6296) 71.0578
LEVEL 7: 69.5699(4545/6533) 72.1887(4545/6296) 70.8551
test.misc (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 90.0000(63/70) 87.5000(63/72) 88.7324
LEVEL 1: 82.8571(58/70) 80.5556(58/72) 81.6901
LEVEL 2: 80.0000(56/70) 77.7778(56/72) 78.8732
LEVEL 3: 65.7143(46/70) 63.8889(46/72) 64.7887
LEVEL 4: 62.8571(44/70) 61.1111(44/72) 61.9718
LEVEL 5: 62.8571(44/70) 61.1111(44/72) 61.9718
LEVEL 6: 62.8571(44/70) 61.1111(44/72) 61.9718
LEVEL 7: 61.4286(43/70) 59.7222(43/72) 60.5634
test.kanjikai (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 93.3333(56/60) 80.0000(56/70) 86.1538
LEVEL 1: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 2: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 3: 78.3333(47/60) 67.1429(47/70) 72.3077
LEVEL 4: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 5: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 6: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 7: 68.3333(41/60) 58.5714(41/70) 63.0769
test.ryomou (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 92.2601(298/323) 93.7107(298/318) 92.9797
LEVEL 1: 74.3034(240/323) 75.4717(240/318) 74.8830
LEVEL 2: 69.9690(226/323) 71.0692(226/318) 70.5148
LEVEL 3: 57.5851(186/323) 58.4906(186/318) 58.0343
LEVEL 4: 50.7740(164/323) 51.5723(164/318) 51.1700
LEVEL 5: 50.7740(164/323) 51.5723(164/318) 51.1700
LEVEL 6: 50.7740(164/323) 51.5723(164/318) 51.1700
LEVEL 7: 50.4644(163/323) 51.2579(163/318) 50.8580
test.place-benchmark (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 95.0617(77/81) 89.5349(77/86) 92.2156
LEVEL 1: 81.4815(66/81) 76.7442(66/86) 79.0419
LEVEL 2: 77.7778(63/81) 73.2558(63/86) 75.4491
LEVEL 3: 64.1975(52/81) 60.4651(52/86) 62.2754
LEVEL 4: 60.4938(49/81) 56.9767(49/86) 58.6826
LEVEL 5: 60.4938(49/81) 56.9767(49/86) 58.6826
LEVEL 6: 60.4938(49/81) 56.9767(49/86) 58.6826
LEVEL 7: 60.4938(49/81) 56.9767(49/86) 58.6826
test.non-KT (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 92.0530(417/453) 90.6522(417/460) 91.3472
LEVEL 1: 77.4834(351/453) 76.3043(351/460) 76.8894
LEVEL 2: 73.9514(335/453) 72.8261(335/460) 73.3844
LEVEL 3: 61.5894(279/453) 60.6522(279/460) 61.1172
LEVEL 4: 55.1876(250/453) 54.3478(250/460) 54.7645
LEVEL 5: 55.1876(250/453) 54.3478(250/460) 54.7645
LEVEL 6: 55.1876(250/453) 54.3478(250/460) 54.7645
LEVEL 7: 54.5254(247/453) 53.6957(247/460) 54.1073
test.mixed (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 91.3255(6380/6986) 94.4346(6380/6756) 92.8540
LEVEL 1: 82.1500(5739/6986) 84.9467(5739/6756) 83.5250
LEVEL 2: 77.5265(5416/6986) 80.1658(5416/6756) 78.8240
LEVEL 3: 71.7435(5012/6986) 74.1859(5012/6756) 72.9443
LEVEL 4: 68.8234(4808/6986) 71.1664(4808/6756) 69.9753
LEVEL 5: 68.8234(4808/6986) 71.1664(4808/6756) 69.9753
LEVEL 6: 68.8234(4808/6986) 71.1664(4808/6756) 69.9753
LEVEL 7: 68.5943(4792/6986) 70.9295(4792/6756) 69.7424
test.all (corpus.kanjikai.mc):
precision recall F
LEVEL 0: 76.1554(72535/95246) 83.3487(72535/87026) 79.5898
LEVEL 1: 64.8899(61805/95246) 71.0190(61805/87026) 67.8162
LEVEL 2: 60.4288(57556/95246) 66.1366(57556/87026) 63.1540
LEVEL 3: 50.6394(48232/95246) 55.4225(48232/87026) 52.9231
LEVEL 4: 47.0098(44775/95246) 51.4501(44775/87026) 49.1299
LEVEL 5: 47.0098(44775/95246) 51.4501(44775/87026) 49.1299
LEVEL 6: 47.0098(44775/95246) 51.4501(44775/87026) 49.1299
LEVEL 7: 46.9133(44683/95246) 51.3444(44683/87026) 49.0289
test.KT0 (corpus.ryomou.mc):
precision recall F
LEVEL 0: 76.9881(72174/93747) 83.3745(72174/86566) 80.0541
LEVEL 1: 67.2331(63029/93747) 72.8103(63029/86566) 69.9107
LEVEL 2: 63.4410(59474/93747) 68.7036(59474/86566) 65.9675
LEVEL 3: 54.6919(51272/93747) 59.2288(51272/86566) 56.8700
LEVEL 4: 50.4101(47258/93747) 54.5919(47258/86566) 52.4177
LEVEL 5: 50.4101(47258/93747) 54.5919(47258/86566) 52.4177
LEVEL 6: 50.4101(47258/93747) 54.5919(47258/86566) 52.4177
LEVEL 7: 50.2981(47153/93747) 54.4706(47153/86566) 52.3013
test.KT2 (corpus.ryomou.mc):
precision recall F
LEVEL 0: 94.1296(6013/6388) 95.5051(6013/6296) 94.8124
LEVEL 1: 87.9618(5619/6388) 89.2471(5619/6296) 88.5998
LEVEL 2: 84.9405(5426/6388) 86.1817(5426/6296) 85.5566
LEVEL 3: 80.5416(5145/6388) 81.7186(5145/6296) 81.1258
LEVEL 4: 77.5360(4953/6388) 78.6690(4953/6296) 78.0984
LEVEL 5: 77.5360(4953/6388) 78.6690(4953/6296) 78.0984
LEVEL 6: 77.5360(4953/6388) 78.6690(4953/6296) 78.0984
LEVEL 7: 77.3482(4941/6388) 78.4784(4941/6296) 77.9092
test.misc (corpus.ryomou.mc):
precision recall F
LEVEL 0: 92.7536(64/69) 88.8889(64/72) 90.7801
LEVEL 1: 84.0580(58/69) 80.5556(58/72) 82.2695
LEVEL 2: 82.6087(57/69) 79.1667(57/72) 80.8511
LEVEL 3: 69.5652(48/69) 66.6667(48/72) 68.0851
LEVEL 4: 63.7681(44/69) 61.1111(44/72) 62.4113
LEVEL 5: 63.7681(44/69) 61.1111(44/72) 62.4113
LEVEL 6: 63.7681(44/69) 61.1111(44/72) 62.4113
LEVEL 7: 60.8696(42/69) 58.3333(42/72) 59.5745
test.kanjikai (corpus.ryomou.mc):
precision recall F
LEVEL 0: 89.4737(51/57) 72.8571(51/70) 80.3150
LEVEL 1: 75.4386(43/57) 61.4286(43/70) 67.7165
LEVEL 2: 71.9298(41/57) 58.5714(41/70) 64.5669
LEVEL 3: 54.3860(31/57) 44.2857(31/70) 48.8189
LEVEL 4: 40.3509(23/57) 32.8571(23/70) 36.2205
LEVEL 5: 40.3509(23/57) 32.8571(23/70) 36.2205
LEVEL 6: 40.3509(23/57) 32.8571(23/70) 36.2205
LEVEL 7: 40.3509(23/57) 32.8571(23/70) 36.2205
test.ryomou (corpus.ryomou.mc):
precision recall F
LEVEL 0: 93.8838(307/327) 96.5409(307/318) 95.1938
LEVEL 1: 84.0979(275/327) 86.4780(275/318) 85.2713
LEVEL 2: 82.5688(270/327) 84.9057(270/318) 83.7209
LEVEL 3: 74.0061(242/327) 76.1006(242/318) 75.0388
LEVEL 4: 68.1957(223/327) 70.1258(223/318) 69.1473
LEVEL 5: 68.1957(223/327) 70.1258(223/318) 69.1473
LEVEL 6: 68.1957(223/327) 70.1258(223/318) 69.1473
LEVEL 7: 67.8899(222/327) 69.8113(222/318) 68.8372
test.place-benchmark (corpus.ryomou.mc):
precision recall F
LEVEL 0: 96.3415(79/82) 91.8605(79/86) 94.0476
LEVEL 1: 84.1463(69/82) 80.2326(69/86) 82.1429
LEVEL 2: 80.4878(66/82) 76.7442(66/86) 78.5714
LEVEL 3: 65.8537(54/82) 62.7907(54/86) 64.2857
LEVEL 4: 65.8537(54/82) 62.7907(54/86) 64.2857
LEVEL 5: 65.8537(54/82) 62.7907(54/86) 64.2857
LEVEL 6: 65.8537(54/82) 62.7907(54/86) 64.2857
LEVEL 7: 65.8537(54/82) 62.7907(54/86) 64.2857
test.non-KT (corpus.ryomou.mc):
precision recall F
LEVEL 0: 93.1567(422/453) 91.7391(422/460) 92.4425
LEVEL 1: 83.0022(376/453) 81.7391(376/460) 82.3658
LEVEL 2: 81.2362(368/453) 80.0000(368/460) 80.6134
LEVEL 3: 70.8609(321/453) 69.7826(321/460) 70.3176
LEVEL 4: 64.0177(290/453) 63.0435(290/460) 63.5268
LEVEL 5: 64.0177(290/453) 63.0435(290/460) 63.5268
LEVEL 6: 64.0177(290/453) 63.0435(290/460) 63.5268
LEVEL 7: 63.3554(287/453) 62.3913(287/460) 62.8697
test.mixed (corpus.ryomou.mc):
precision recall F
LEVEL 0: 94.0652(6435/6841) 95.2487(6435/6756) 94.6532
LEVEL 1: 87.6334(5995/6841) 88.7359(5995/6756) 88.1812
LEVEL 2: 84.6952(5794/6841) 85.7608(5794/6756) 85.2247
LEVEL 3: 79.9006(5466/6841) 80.9059(5466/6756) 80.4001
LEVEL 4: 76.6408(5243/6841) 77.6051(5243/6756) 77.1200
LEVEL 5: 76.6408(5243/6841) 77.6051(5243/6756) 77.1200
LEVEL 6: 76.6408(5243/6841) 77.6051(5243/6756) 77.1200
LEVEL 7: 76.4216(5228/6841) 77.3831(5228/6756) 76.8993
test.all (corpus.ryomou.mc):
precision recall F
LEVEL 0: 77.0658(72596/94200) 83.4187(72596/87026) 80.1165
LEVEL 1: 67.3089(63405/94200) 72.8575(63405/87026) 69.9734
LEVEL 2: 63.5265(59842/94200) 68.7634(59842/87026) 66.0413
LEVEL 3: 54.7696(51593/94200) 59.2846(51593/87026) 56.9377
LEVEL 4: 50.4756(47548/94200) 54.6365(47548/87026) 52.4737
LEVEL 5: 50.4756(47548/94200) 54.6365(47548/87026) 52.4737
LEVEL 6: 50.4756(47548/94200) 54.6365(47548/87026) 52.4737
LEVEL 7: 50.3609(47440/94200) 54.5124(47440/87026) 52.3545
test.KT0 (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 74.6173(71990/96479) 83.1620(71990/86566) 78.6583
LEVEL 1: 64.5063(62235/96479) 71.8931(62235/86566) 67.9997
LEVEL 2: 61.1884(59034/96479) 68.1954(59034/86566) 64.5022
LEVEL 3: 52.4653(50618/96479) 58.4733(50618/86566) 55.3066
LEVEL 4: 48.1835(46487/96479) 53.7012(46487/86566) 50.7930
LEVEL 5: 48.1835(46487/96479) 53.7012(46487/86566) 50.7930
LEVEL 6: 48.1835(46487/96479) 53.7012(46487/86566) 50.7930
LEVEL 7: 48.0840(46391/96479) 53.5903(46391/86566) 50.6881
test.KT2 (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 87.9838(5865/6666) 93.1544(5865/6296) 90.4953
LEVEL 1: 80.0180(5334/6666) 84.7205(5334/6296) 82.3021
LEVEL 2: 77.0477(5136/6666) 81.5756(5136/6296) 79.2470
LEVEL 3: 72.8323(4855/6666) 77.1125(4855/6296) 74.9113
LEVEL 4: 69.0819(4605/6666) 73.1417(4605/6296) 71.0538
LEVEL 5: 69.0819(4605/6666) 73.1417(4605/6296) 71.0538
LEVEL 6: 69.0819(4605/6666) 73.1417(4605/6296) 71.0538
LEVEL 7: 68.9019(4593/6666) 72.9511(4593/6296) 70.8687
test.misc (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 87.3239(62/71) 86.1111(62/72) 86.7133
LEVEL 1: 78.8732(56/71) 77.7778(56/72) 78.3217
LEVEL 2: 76.0563(54/71) 75.0000(54/72) 75.5245
LEVEL 3: 63.3803(45/71) 62.5000(45/72) 62.9371
LEVEL 4: 60.5634(43/71) 59.7222(43/72) 60.1399
LEVEL 5: 60.5634(43/71) 59.7222(43/72) 60.1399
LEVEL 6: 60.5634(43/71) 59.7222(43/72) 60.1399
LEVEL 7: 59.1549(42/71) 58.3333(42/72) 58.7413
test.kanjikai (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 93.3333(56/60) 80.0000(56/70) 86.1538
LEVEL 1: 81.6667(49/60) 70.0000(49/70) 75.3846
LEVEL 2: 80.0000(48/60) 68.5714(48/70) 73.8462
LEVEL 3: 61.6667(37/60) 52.8571(37/70) 56.9231
LEVEL 4: 46.6667(28/60) 40.0000(28/70) 43.0769
LEVEL 5: 46.6667(28/60) 40.0000(28/70) 43.0769
LEVEL 6: 46.6667(28/60) 40.0000(28/70) 43.0769
LEVEL 7: 45.0000(27/60) 38.5714(27/70) 41.5385
test.ryomou (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 89.7281(297/331) 93.3962(297/318) 91.5254
LEVEL 1: 73.7160(244/331) 76.7296(244/318) 75.1926
LEVEL 2: 69.7885(231/331) 72.6415(231/318) 71.1864
LEVEL 3: 58.3082(193/331) 60.6918(193/318) 59.4761
LEVEL 4: 53.1722(176/331) 55.3459(176/318) 54.2373
LEVEL 5: 53.1722(176/331) 55.3459(176/318) 54.2373
LEVEL 6: 53.1722(176/331) 55.3459(176/318) 54.2373
LEVEL 7: 52.8701(175/331) 55.0314(175/318) 53.9291
test.place-benchmark (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 100.0000(86/86) 100.0000(86/86) 100.0000
LEVEL 1: 94.1860(81/86) 94.1860(81/86) 94.1860
LEVEL 2: 93.0233(80/86) 93.0233(80/86) 93.0233
LEVEL 3: 83.7209(72/86) 83.7209(72/86) 83.7209
LEVEL 4: 80.2326(69/86) 80.2326(69/86) 80.2326
LEVEL 5: 80.2326(69/86) 80.2326(69/86) 80.2326
LEVEL 6: 80.2326(69/86) 80.2326(69/86) 80.2326
LEVEL 7: 80.2326(69/86) 80.2326(69/86) 80.2326
test.non-KT (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 89.8268(415/462) 90.2174(415/460) 90.0217
LEVEL 1: 75.5411(349/462) 75.8696(349/460) 75.7050
LEVEL 2: 72.0779(333/462) 72.3913(333/460) 72.2343
LEVEL 3: 59.5238(275/462) 59.7826(275/460) 59.6529
LEVEL 4: 53.4632(247/462) 53.6957(247/460) 53.5792
LEVEL 5: 53.4632(247/462) 53.6957(247/460) 53.5792
LEVEL 6: 53.4632(247/462) 53.6957(247/460) 53.5792
LEVEL 7: 52.8139(244/462) 53.0435(244/460) 52.9284
test.mixed (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 88.1033(6280/7128) 92.9544(6280/6756) 90.4638
LEVEL 1: 79.7278(5683/7128) 84.1178(5683/6756) 81.8640
LEVEL 2: 76.7256(5469/7128) 80.9503(5469/6756) 78.7813
LEVEL 3: 71.9697(5130/7128) 75.9325(5130/6756) 73.8980
LEVEL 4: 68.0696(4852/7128) 71.8176(4852/6756) 69.8934
LEVEL 5: 68.0696(4852/7128) 71.8176(4852/6756) 69.8934
LEVEL 6: 68.0696(4852/7128) 71.8176(4852/6756) 69.8934
LEVEL 7: 67.8591(4837/7128) 71.5956(4837/6756) 69.6773
test.all (corpus.place-benchmark.mc):
precision recall F
LEVEL 0: 74.6898(72405/96941) 83.1993(72405/87026) 78.7152
LEVEL 1: 64.5589(62584/96941) 71.9141(62584/87026) 68.0383
LEVEL 2: 61.2403(59367/96941) 68.2175(59367/87026) 64.5409
LEVEL 3: 52.4989(50893/96941) 58.4802(50893/87026) 55.3284
LEVEL 4: 48.2087(46734/96941) 53.7012(46734/87026) 50.8069
LEVEL 5: 48.2087(46734/96941) 53.7012(46734/87026) 50.8069
LEVEL 6: 48.2087(46734/96941) 53.7012(46734/87026) 50.8069
LEVEL 7: 48.1066(46635/96941) 53.5874(46635/87026) 50.6993
test.KT0 (corpus.non-KT.mc):
precision recall F
LEVEL 0: 77.2588(73246/94806) 84.6129(73246/86566) 80.7688
LEVEL 1: 68.0674(64532/94806) 74.5466(64532/86566) 71.1598
LEVEL 2: 64.4896(61140/94806) 70.6282(61140/86566) 67.4194
LEVEL 3: 56.1072(53193/94806) 61.4479(53193/86566) 58.6562
LEVEL 4: 52.3638(49644/94806) 57.3482(49644/86566) 54.7427
LEVEL 5: 52.3638(49644/94806) 57.3482(49644/86566) 54.7427
LEVEL 6: 52.3638(49644/94806) 57.3482(49644/86566) 54.7427
LEVEL 7: 52.2446(49531/94806) 57.2176(49531/86566) 54.6181
test.KT2 (corpus.non-KT.mc):
precision recall F
LEVEL 0: 93.8400(6063/6461) 96.2992(6063/6296) 95.0537
LEVEL 1: 88.0204(5687/6461) 90.3272(5687/6296) 89.1589
LEVEL 2: 85.0797(5497/6461) 87.3094(5497/6296) 86.1801
LEVEL 3: 81.0246(5235/6461) 83.1480(5235/6296) 82.0726
LEVEL 4: 78.1303(5048/6461) 80.1779(5048/6296) 79.1409
LEVEL 5: 78.1303(5048/6461) 80.1779(5048/6296) 79.1409
LEVEL 6: 78.1303(5048/6461) 80.1779(5048/6296) 79.1409
LEVEL 7: 77.9446(5036/6461) 79.9873(5036/6296) 78.9527
test.misc (corpus.non-KT.mc):
precision recall F
LEVEL 0: 100.0000(72/72) 100.0000(72/72) 100.0000
LEVEL 1: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 2: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 3: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 4: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 5: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 6: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 7: 80.5556(58/72) 80.5556(58/72) 80.5556
test.kanjikai (corpus.non-KT.mc):
precision recall F
LEVEL 0: 93.3333(56/60) 80.0000(56/70) 86.1538
LEVEL 1: 88.3333(53/60) 75.7143(53/70) 81.5385
LEVEL 2: 86.6667(52/60) 74.2857(52/70) 80.0000
LEVEL 3: 76.6667(46/60) 65.7143(46/70) 70.7692
LEVEL 4: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 5: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 6: 70.0000(42/60) 60.0000(42/70) 64.6154
LEVEL 7: 68.3333(41/60) 58.5714(41/70) 63.0769
test.ryomou (corpus.non-KT.mc):
precision recall F
LEVEL 0: 93.2927(306/328) 96.2264(306/318) 94.7368
LEVEL 1: 82.0122(269/328) 84.5912(269/318) 83.2817
LEVEL 2: 80.1829(263/328) 82.7044(263/318) 81.4241
LEVEL 3: 72.2561(237/328) 74.5283(237/318) 73.3746
LEVEL 4: 67.3780(221/328) 69.4969(221/318) 68.4211
LEVEL 5: 67.3780(221/328) 69.4969(221/318) 68.4211
LEVEL 6: 67.3780(221/328) 69.4969(221/318) 68.4211
LEVEL 7: 67.0732(220/328) 69.1824(220/318) 68.1115
test.place-benchmark (corpus.non-KT.mc):
precision recall F
LEVEL 0: 95.0617(77/81) 89.5349(77/86) 92.2156
LEVEL 1: 86.4198(70/81) 81.3953(70/86) 83.8323
LEVEL 2: 82.7160(67/81) 77.9070(67/86) 80.2395
LEVEL 3: 69.1358(56/81) 65.1163(56/86) 67.0659
LEVEL 4: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 5: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 6: 65.4321(53/81) 61.6279(53/86) 63.4731
LEVEL 7: 65.4321(53/81) 61.6279(53/86) 63.4731
test.non-KT (corpus.non-KT.mc):
precision recall F
LEVEL 0: 94.3478(434/460) 94.3478(434/460) 94.3478
LEVEL 1: 85.2174(392/460) 85.2174(392/460) 85.2174
LEVEL 2: 83.6957(385/460) 83.6957(385/460) 83.6957
LEVEL 3: 75.4348(347/460) 75.4348(347/460) 75.4348
LEVEL 4: 70.2174(323/460) 70.2174(323/460) 70.2174
LEVEL 5: 70.2174(323/460) 70.2174(323/460) 70.2174
LEVEL 6: 70.2174(323/460) 70.2174(323/460) 70.2174
LEVEL 7: 69.3478(319/460) 69.3478(319/460) 69.3478
test.mixed (corpus.non-KT.mc):
precision recall F
LEVEL 0: 93.8737(6497/6921) 96.1664(6497/6756) 95.0062
LEVEL 1: 87.8341(6079/6921) 89.9793(6079/6756) 88.8938
LEVEL 2: 84.9877(5882/6921) 87.0634(5882/6756) 86.0130
LEVEL 3: 80.6531(5582/6921) 82.6229(5582/6756) 81.6261
LEVEL 4: 77.6044(5371/6921) 79.4997(5371/6756) 78.5406
LEVEL 5: 77.6044(5371/6921) 79.4997(5371/6756) 78.5406
LEVEL 6: 77.6044(5371/6921) 79.4997(5371/6756) 78.5406
LEVEL 7: 77.3732(5355/6921) 79.2629(5355/6756) 78.3066
test.all (corpus.non-KT.mc):
precision recall F
LEVEL 0: 77.3413(73680/95266) 84.6644(73680/87026) 80.8373
LEVEL 1: 68.1502(64924/95266) 74.6030(64924/87026) 71.2308
LEVEL 2: 64.5823(61525/95266) 70.6973(61525/87026) 67.5016
LEVEL 3: 56.2005(53540/95266) 61.5218(53540/87026) 58.7409
LEVEL 4: 52.4500(49967/95266) 57.4162(49967/87026) 54.8208
LEVEL 5: 52.4500(49967/95266) 57.4162(49967/87026) 54.8208
LEVEL 6: 52.4500(49967/95266) 57.4162(49967/87026) 54.8208
LEVEL 7: 52.3272(49850/95266) 57.2817(49850/87026) 54.6925
test.KT0 (corpus.mixed.mc):
precision recall F
LEVEL 0: 77.9443(73574/94393) 84.9918(73574/86566) 81.3157
LEVEL 1: 71.5530(67541/94393) 78.0225(67541/86566) 74.6478
LEVEL 2: 69.3918(65501/94393) 75.6660(65501/86566) 72.3932
LEVEL 3: 62.1783(58692/94393) 67.8003(58692/86566) 64.8677
LEVEL 4: 58.8073(55510/94393) 64.1245(55510/86566) 61.3509
LEVEL 5: 58.8073(55510/94393) 64.1245(55510/86566) 61.3509
LEVEL 6: 58.8073(55510/94393) 64.1245(55510/86566) 61.3509
LEVEL 7: 58.6760(55386/94393) 63.9812(55386/86566) 61.2139
test.KT2 (corpus.mixed.mc):
precision recall F
LEVEL 0: 95.6630(6154/6433) 97.7446(6154/6296) 96.6926
LEVEL 1: 95.2588(6128/6433) 97.3316(6128/6296) 96.2841
LEVEL 2: 95.0723(6116/6433) 97.1410(6116/6296) 96.0955
LEVEL 3: 93.8598(6038/6433) 95.9022(6038/6296) 94.8700
LEVEL 4: 93.3313(6004/6433) 95.3621(6004/6296) 94.3358
LEVEL 5: 93.3313(6004/6433) 95.3621(6004/6296) 94.3358
LEVEL 6: 93.3313(6004/6433) 95.3621(6004/6296) 94.3358
LEVEL 7: 93.1136(5990/6433) 95.1398(5990/6296) 94.1158
test.misc (corpus.mixed.mc):
precision recall F
LEVEL 0: 100.0000(72/72) 100.0000(72/72) 100.0000
LEVEL 1: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 2: 97.2222(70/72) 97.2222(70/72) 97.2222
LEVEL 3: 88.8889(64/72) 88.8889(64/72) 88.8889
LEVEL 4: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 5: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 6: 83.3333(60/72) 83.3333(60/72) 83.3333
LEVEL 7: 80.5556(58/72) 80.5556(58/72) 80.5556
test.kanjikai (corpus.mixed.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 2: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 3: 76.2712(45/59) 64.2857(45/70) 69.7674
LEVEL 4: 69.4915(41/59) 58.5714(41/70) 63.5659
LEVEL 5: 69.4915(41/59) 58.5714(41/70) 63.5659
LEVEL 6: 69.4915(41/59) 58.5714(41/70) 63.5659
LEVEL 7: 67.7966(40/59) 57.1429(40/70) 62.0155
test.ryomou (corpus.mixed.mc):
precision recall F
LEVEL 0: 94.4785(308/326) 96.8553(308/318) 95.6522
LEVEL 1: 83.7423(273/326) 85.8491(273/318) 84.7826
LEVEL 2: 82.8221(270/326) 84.9057(270/318) 83.8509
LEVEL 3: 73.0061(238/326) 74.8428(238/318) 73.9130
LEVEL 4: 66.8712(218/326) 68.5535(218/318) 67.7019
LEVEL 5: 66.8712(218/326) 68.5535(218/318) 67.7019
LEVEL 6: 66.8712(218/326) 68.5535(218/318) 67.7019
LEVEL 7: 66.5644(217/326) 68.2390(217/318) 67.3913
test.place-benchmark (corpus.mixed.mc):
precision recall F
LEVEL 0: 96.3855(80/83) 93.0233(80/86) 94.6746
LEVEL 1: 86.7470(72/83) 83.7209(72/86) 85.2071
LEVEL 2: 84.3373(70/83) 81.3953(70/86) 82.8402
LEVEL 3: 73.4940(61/83) 70.9302(61/86) 72.1893
LEVEL 4: 71.0843(59/83) 68.6047(59/86) 69.8225
LEVEL 5: 71.0843(59/83) 68.6047(59/86) 69.8225
LEVEL 6: 71.0843(59/83) 68.6047(59/86) 69.8225
LEVEL 7: 71.0843(59/83) 68.6047(59/86) 69.8225
test.non-KT (corpus.mixed.mc):
precision recall F
LEVEL 0: 94.9672(434/457) 94.3478(434/460) 94.6565
LEVEL 1: 86.4333(395/457) 85.8696(395/460) 86.1505
LEVEL 2: 85.7768(392/457) 85.2174(392/460) 85.4962
LEVEL 3: 75.9300(347/457) 75.4348(347/460) 75.6816
LEVEL 4: 69.8031(319/457) 69.3478(319/460) 69.5747
LEVEL 5: 69.8031(319/457) 69.3478(319/460) 69.5747
LEVEL 6: 69.8031(319/457) 69.3478(319/460) 69.5747
LEVEL 7: 68.9278(315/457) 68.4783(315/460) 68.7023
test.mixed (corpus.mixed.mc):
precision recall F
LEVEL 0: 95.6168(6588/6890) 97.5133(6588/6756) 96.5558
LEVEL 1: 94.6734(6523/6890) 96.5512(6523/6756) 95.6031
LEVEL 2: 94.4557(6508/6890) 96.3292(6508/6756) 95.3833
LEVEL 3: 92.6705(6385/6890) 94.5086(6385/6756) 93.5805
LEVEL 4: 91.7707(6323/6890) 93.5909(6323/6756) 92.6718
LEVEL 5: 91.7707(6323/6890) 93.5909(6323/6756) 92.6718
LEVEL 6: 91.7707(6323/6890) 93.5909(6323/6756) 92.6718
LEVEL 7: 91.5094(6305/6890) 93.3245(6305/6756) 92.4080
test.all (corpus.mixed.mc):
precision recall F
LEVEL 0: 78.0264(74008/94850) 85.0413(74008/87026) 81.3829
LEVEL 1: 71.6247(67936/94850) 78.0640(67936/87026) 74.7058
LEVEL 2: 69.4707(65893/94850) 75.7165(65893/87026) 72.4593
LEVEL 3: 62.2446(59039/94850) 67.8406(59039/87026) 64.9223
LEVEL 4: 58.8603(55829/94850) 64.1521(55829/87026) 61.3924
LEVEL 5: 58.8603(55829/94850) 64.1521(55829/87026) 61.3924
LEVEL 6: 58.8603(55829/94850) 64.1521(55829/87026) 61.3924
LEVEL 7: 58.7254(55701/94850) 64.0050(55701/87026) 61.2516
test.KT0 (corpus.all.mc):
precision recall F
LEVEL 0: 78.1213(74548/95426) 86.1170(74548/86566) 81.9245
LEVEL 1: 72.5892(69269/95426) 80.0187(69269/86566) 76.1231
LEVEL 2: 71.2458(67987/95426) 78.5378(67987/86566) 74.7143
LEVEL 3: 64.5967(61642/95426) 71.2081(61642/86566) 67.7414
LEVEL 4: 61.1951(58396/95426) 67.4584(58396/86566) 64.1742
LEVEL 5: 61.1951(58396/95426) 67.4584(58396/86566) 64.1742
LEVEL 6: 61.1951(58396/95426) 67.4584(58396/86566) 64.1742
LEVEL 7: 61.0546(58262/95426) 67.3036(58262/86566) 64.0270
test.KT2 (corpus.all.mc):
precision recall F
LEVEL 0: 95.5677(6145/6430) 97.6017(6145/6296) 96.5739
LEVEL 1: 94.6190(6084/6430) 96.6328(6084/6296) 95.6153
LEVEL 2: 94.1835(6056/6430) 96.1881(6056/6296) 95.1752
LEVEL 3: 92.6128(5955/6430) 94.5839(5955/6296) 93.5879
LEVEL 4: 91.5397(5886/6430) 93.4879(5886/6296) 92.5035
LEVEL 5: 91.5397(5886/6430) 93.4879(5886/6296) 92.5035
LEVEL 6: 91.5397(5886/6430) 93.4879(5886/6296) 92.5035
LEVEL 7: 91.3375(5873/6430) 93.2814(5873/6296) 92.2992
test.misc (corpus.all.mc):
precision recall F
LEVEL 0: 94.5946(70/74) 97.2222(70/72) 95.8904
LEVEL 1: 91.8919(68/74) 94.4444(68/72) 93.1507
LEVEL 2: 90.5405(67/74) 93.0556(67/72) 91.7808
LEVEL 3: 82.4324(61/74) 84.7222(61/72) 83.5616
LEVEL 4: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 5: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 6: 79.7297(59/74) 81.9444(59/72) 80.8219
LEVEL 7: 77.0270(57/74) 79.1667(57/72) 78.0822
test.kanjikai (corpus.all.mc):
precision recall F
LEVEL 0: 91.5254(54/59) 77.1429(54/70) 83.7209
LEVEL 1: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 2: 88.1356(52/59) 74.2857(52/70) 80.6202
LEVEL 3: 74.5763(44/59) 62.8571(44/70) 68.2171
LEVEL 4: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 5: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 6: 66.1017(39/59) 55.7143(39/70) 60.4651
LEVEL 7: 64.4068(38/59) 54.2857(38/70) 58.9147
test.ryomou (corpus.all.mc):
precision recall F
LEVEL 0: 92.7052(305/329) 95.9119(305/318) 94.2813
LEVEL 1: 81.1550(267/329) 83.9623(267/318) 82.5348
LEVEL 2: 79.9392(263/329) 82.7044(263/318) 81.2983
LEVEL 3: 70.8207(233/329) 73.2704(233/318) 72.0247
LEVEL 4: 65.9574(217/329) 68.2390(217/318) 67.0788
LEVEL 5: 65.9574(217/329) 68.2390(217/318) 67.0788
LEVEL 6: 65.9574(217/329) 68.2390(217/318) 67.0788
LEVEL 7: 65.6535(216/329) 67.9245(216/318) 66.7697
test.place-benchmark (corpus.all.mc):
precision recall F
LEVEL 0: 100.0000(86/86) 100.0000(86/86) 100.0000
LEVEL 1: 89.5349(77/86) 89.5349(77/86) 89.5349
LEVEL 2: 88.3721(76/86) 88.3721(76/86) 88.3721
LEVEL 3: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 4: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 5: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 6: 79.0698(68/86) 79.0698(68/86) 79.0698
LEVEL 7: 79.0698(68/86) 79.0698(68/86) 79.0698
test.non-KT (corpus.all.mc):
precision recall F
LEVEL 0: 92.8571(429/462) 93.2609(429/460) 93.0586
LEVEL 1: 83.7662(387/462) 84.1304(387/460) 83.9479
LEVEL 2: 82.6840(382/462) 83.0435(382/460) 82.8633
LEVEL 3: 73.1602(338/462) 73.4783(338/460) 73.3189
LEVEL 4: 68.1818(315/462) 68.4783(315/460) 68.3297
LEVEL 5: 68.1818(315/462) 68.4783(315/460) 68.3297
LEVEL 6: 68.1818(315/462) 68.4783(315/460) 68.3297
LEVEL 7: 67.3160(311/462) 67.6087(311/460) 67.4620
test.mixed (corpus.all.mc):
precision recall F
LEVEL 0: 95.3860(6574/6892) 97.3061(6574/6756) 96.3365
LEVEL 1: 93.8915(6471/6892) 95.7815(6471/6756) 94.8271
LEVEL 2: 93.4127(6438/6892) 95.2931(6438/6756) 94.3435
LEVEL 3: 91.3088(6293/6892) 93.1468(6293/6756) 92.2186
LEVEL 4: 89.9739(6201/6892) 91.7851(6201/6756) 90.8705
LEVEL 5: 89.9739(6201/6892) 91.7851(6201/6756) 90.8705
LEVEL 6: 89.9739(6201/6892) 91.7851(6201/6756) 90.8705
LEVEL 7: 89.7272(6184/6892) 91.5335(6184/6756) 90.6213
test.all (corpus.all.mc):
precision recall F
LEVEL 0: 78.1923(74977/95888) 86.1547(74977/87026) 81.9806
LEVEL 1: 72.6431(69656/95888) 80.0404(69656/87026) 76.1626
LEVEL 2: 71.3009(68369/95888) 78.5616(68369/87026) 74.7553
LEVEL 3: 64.6379(61980/95888) 71.2201(61980/87026) 67.7696
LEVEL 4: 61.2287(58711/95888) 67.4637(58711/87026) 64.1952
LEVEL 5: 61.2287(58711/95888) 67.4637(58711/87026) 64.1952
LEVEL 6: 61.2287(58711/95888) 67.4637(58711/87026) 64.1952
LEVEL 7: 61.0848(58573/95888) 67.3052(58573/87026) 64.0443
seed_KTp2c/system-eval.sh 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/system-eval.sh
\ No newline at end of file
seed_KTp2c/unk.def 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/unk.def
\ No newline at end of file
seed_KTp2c/unk.dic 0 → 100644
+ 0
− 0
View file @ 68543c74
File added
seed_KTp2c/ymzknk.Interjection.csv 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/ymzknk.Interjection.csv
\ No newline at end of file
seed_KTp2c/ymzknk.Numeral.60.csv 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed-src/ymzknk.Numeral.60.csv
\ No newline at end of file
seed_KTp2c/ymzknk.Numeral.csv 0 → 120000
+ 1
− 0
View file @ 68543c74
../seed/ymzknk.Numeral.csv
\ No newline at end of file
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment