blastbao / pycws Goto Github PK

src/cwsFMM.py -- source code of tool cwFMM

src/pku_training.utf8 -- training data

src/pku_test.utf8 -- test data

socre/score -- tools to socre the result

socre/pku_test_gold.utf8 -- gold data

ref -- reference papers of the project

Using Backward Maximum Match(BMM) algorithm to do Chinese Word Segamentation

python cwsBMM.py training_file test_file result_file

perl score training_file gold_file result_file > score_file

Using Forward Maximum Match(BMM) algorithm to do Chinese Word Segamentation

python cwsFMM.py training_file test_file result_file

perl score training_file gold_file result_file > score_file