The jieba-go from ericlingit

jieba-go's People

Contributors

Watchers

jieba-go's Issues

TestCut randomly fails.

TestCut test case "cut 2 我昨天去上海交通大學與老師討論量子力學" randomly fails once very 10-15 runs.

DAG path and their probabilities for the failed run:

dag: map[
    0:[1]
    1:[2 3] // 昨 昨天
    2:[3]
    3:[4]
    4:[5 6] // 上 上海
    5:[6]
    6:[7 8] // 交 交通
    7:[8]
    8:[9]
    9:[10]
    10:[11]
    11:[12]
    12:[13]
    13:[14]
    14:[15]
    15:[16 17] // 量 量子
    16:[17 18] // 子 子力
    17:[18]
    18:[19]
]

dagProba: map[
    0:map[1:-177.6170727349524]
    1:map[2:-182.89744596289123 3:-172.4088492374512] // 昨 昨天
    2:map[3:-170.3749645649525]
    3:map[4:-162.95410215109712]
    4:map[5:-153.40989245430066 6:-156.76575162111942] // 上 上海
    5:map[6:-147.9594455867119]
    6:map[7:-148.55783168381407 8:-139.2252963306866] // 交 交通
    7:map[8:-139.3501172757491]
    8:map[9:-130.61099494689685]
    9:map[10:-124.5776976614799]
    10:map[11:-108.45790400295274]
    11:map[12:-92.62579241687736]
    12:map[13:-85.13123885384957]
    13:map[14:-72.05596763304582]
    14:map[15:-54.144414505290605]
    15:map[16:-40.22961652978732 17:-36.232861377535386] // 量 量子
    16:map[17:-32.80086286953987 18:-31.546440136494383] // 子 子力
    17:map[18:-24.746177273685554]
    18:map[19:-16.119793658527165]
]

In dagProba[4], index 5 (-153.40, 上) somehow has a higher probability than index 6 (-156.76, 上海).

Recommend Projects