wangbin / jiebago Goto Github PK

View Code? Open in Web Editor NEW

487.0 487.0 115.0 9.09 MB

Jieba 分词 Go 语言版

Go 100.00%

jiebago's People

Contributors

Stargazers

Watchers

Forkers

bububa insionng angrybears bozzcq liudch kingpro mothod cluo ithacadream debuggingfuture taoh onetodo dzch 9466 flashknight vseledkin andeya hengfeiyang masiqi hinike orsonwang linkedin-inc elvin-du beckbikang darren veterun semua eternnoir msn217 douzzi zhy0313 luci4r cjlibra liudanking julianshen notacoder rosbit lgdkobe24 mindon zzn01 guoyu07 dao12dao matthewfan leonliu315 jaysharp xormplus hanksantford linpingchuan filoteo jinligen hy05190134 kissthink ganggang yehuangcn kricen limard saisiyun smartfish hanqian200705 liuhuanqiang 5up3rc linkdrone xmader cmemory lennon-guan selead dst1213 zealass liujiawm chenniannian90 ttys3 hollychen503 sansna f4nyc mojiehai softwaredevtest qq431169079 tangzuqiang rivenzoo jiurenm zhanglei quantumghost meicsu199345 mealleader andyzhou gleke weblfe ocaraworks 5l1v3r1 nblib soontao isgasho davidcao626 myjeffxie fanchunmeng-98 spellingdragon luhuaei huangyoutian straysh kiter

jiebago's Issues

invalid memory address or nil pointer dereference

package main

import (
	"log"

	"github.com/wangbin/jiebago"
)
var seg jiebago.Segmenter
func main() {
	log.Println(seg.CutAll("我来到北京清华大学"))
}

panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xc0000005 code=0x1 addr=0x28 pc=0x4bcf13]

goroutine 4 [running]:
sync.(*RWMutex).RLock(...)
        C:/Go/src/sync/rwmutex.go:48
github.com/wangbin/jiebago.(*Dictionary).Frequency(0x0, 0xc0001c5dd8, 0x3, 0x20, 0xc0001c5dd8)
        C:/Users/amz/Desktop/gotest/src/github.com/wangbin/jiebago/dictionary.go:54 +0x33
github.com/wangbin/jiebago.(*Segmenter).dag(0x625688, 0xc0001c5ea0, 0x9, 0x20, 0x9)
        C:/Users/amz/Desktop/gotest/src/github.com/wangbin/jiebago/jieba.go:118 +0xbe
github.com/wangbin/jiebago.(*Segmenter).cutAll.func1(0x4fe190, 0x1b, 0x625688, 0xc000010060)
        C:/Users/amz/Desktop/gotest/src/github.com/wangbin/jiebago/jieba.go:303 +0x9d
created by github.com/wangbin/jiebago.(*Segmenter).cutAll
        C:/Users/amz/Desktop/gotest/src/github.com/wangbin/jiebago/jieba.go:301 +0x86
exit status

Deadlock if invalid format of stop words

For stop words, valid format is : one stop word in each line.

Extra spaces followed stop word may cause error, and will be sent to errCh (unbuffered channel). Refers to dictionary.go#L38.
But dictionary.go#L68 still waits for tokenCh, therefore dictionary.go#L70 can not receive from errCh, finally DeadLock occurs.

There is the same problem, if error(dictionary.go#L49 ) occurs.

请问下，支持基于 TF-IDF 算法的关键词抽取么

编译教程示例时报错

jie.go:6:2: found packages jiebago (dictionary.go) and main (jie.go) in /home/yu/go/src/github.com/wangbin/jiebago
我把教程中的内容保存在jie.go文件中后，使用go build jie.go时出现错误，不能编译

求问如何解决

Build Error: go build -o c:\Users\tieto\Downloads\91porn_spider-master\score__debug_bin3440546766.exe -gcflags all=-N -l .

spider91/score

.\score.go:14:20: undefined: gojieba.Jieba
.\score.go:22:15: undefined: gojieba.NewJieba (exit status 1)

will cause an index out of range panic
when i = len(pairs) - 1 (the last element of the pairs)

change j <= len(pairs) to j < len(pairs) should fix it.

Anomalous panic occurs when loading data, it is not clear

As title