Code Monkey home page Code Monkey logo

kernelgat's Introduction

Kernel Graph Attention Network (KGAT)

There are source codes for Fine-grained Fact Verification with Kernel Graph Attention Network.

model

For more information about the FEVER 1.0 shared task can be found on this website.

๐Ÿ˜ƒ What's New

Fact Extraction and Verification with SCIFACT

The shared task introduces scientific claim verification for helping scientists, clinicians, and public to verify the credibility of such claims with scientific literature, especially for the claims related to COVID-19.
>> Reproduce Our Results >> About SCIFACT Dataset >> Our Paper

Requirement

  • Python 3.X
  • fever_score
  • Pytorch
  • pytorch_pretrained_bert
  • transformers

Data and Checkpoint

  • All data and BERT based chechpoints can be found at Ali Drive.
  • RoBERTa based models and chechpoints can be found at Ali Drive.

Retrieval Model

  • BERT based ranker.
  • Go to the retrieval_model folder for more information.

Pretrain Model

  • Pre-train BERT with claim-evidence pairs.
  • Go to the pretrain folder for more information.

KGAT Model

  • Our KGAT model.
  • Go to the kgat folder for more information.

Results

The results are all on Codalab leaderboard.

User Pre-train Model Label Accuracy FEVER Score
GEAR_single BERT (Base) 0.7160 0.6710
a.soleimani.b BERT (Large) 0.7186 0.6966
KGAT RoBERTa (Large) 0.7407 0.7038

KGAT performance with different pre-trained language model.

Pre-train Model Label Accuracy FEVER Score
BERT (Base) 0.7281 0.6940
BERT (Large) 0.7361 0.7024
RoBERTa (Large) 0.7407 0.7038
CorefBERT (RoBERT Large) 0.7596 0.7230

Citation

@inproceedings{liu2020kernel,
  title={Fine-grained Fact Verification with Kernel Graph Attention Network},
  author={Liu, Zhenghao and Xiong, Chenyan and Sun, Maosong and Liu, Zhiyuan},
  booktitle={Proceedings of ACL},
  year={2020}
}
@inproceedings{liu2020adapting,
    title = {Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling},
    author = {Liu, Zhenghao and Xiong, Chenyan and Dai, Zhuyun and Sun, Si and Sun, Maosong and Liu, Zhiyuan},
    booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2020},
   year={2020}
}

Contact

If you have questions, suggestions and bug reports, please email:

kernelgat's People

Contributors

edwardzh avatar dependabot[bot] avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.