Code Monkey home page Code Monkey logo

Comments (2)

v-mipeng avatar v-mipeng commented on July 21, 2024

对于问题1: 可以考虑用字级别的方法做中文命名实体识别，避免分词错误。
对于问题2: 这种情况“北京上海”会被当作一个命名实体。你可以考虑引入无监督分词（基于n-gram语言模型）来解决这个问题。另外，“北京上海”之间一般会加个标点符号隔开。

from lexiconner.

pmouren avatar pmouren commented on July 21, 2024
  • 作者您好，我有一个疑惑希望可以得到您的解答
  • 你基于英文的每一个词是可以拆分到单个字母，做embeding， 中文的话是否要分词？但是分词存在边界很有可能就错了
  • 在一个是实体词重合，你是怎么考虑的？比如说，北京上海都是一个国际大都市, 会出来 [1,1,1,1,0,0,0,0,0,0,0,0], 那现在的做法是直接将 北京上海看成一个实体词吗？

您好，请问您最后在中文数据集上复现了么

from lexiconner.

Related Issues (14)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.