Light

zzz47zzz / cet Goto Github PK

View Code? Open in Web Editor NEW

15.0 1.0 0.0 455 KB

[ACL2023] Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference

Home Page: https://aclanthology.org/2023.acl-long.509/

Python 100.00%

causal-inference fine-tuning pretrained-language-model

cet's Introduction

Hi there 👋

🔭 I’m zheng junhao (郑俊豪). I’m currently a PhD student in South China University of Technology
🤔 My research interests include large language models, continual learning/incremental learning, causal inference. [Google Scholar][Github]
📫 How to reach me: A @ B dot C, where A is junhaozheng47, B is outlook, C is com

gtihub-visitors

cet's People

Contributors

Stargazers

Watchers

cet's Issues

DataParallel该怎么用

按照源代码来跑，报错：AttributeError: 'DataParallel' object has no attribute 'train_model'。定位到问题应该是运行 mian.py 中 model = torch.nn.DataParallel(model, device_ids=list(range(torch.cuda.device_count())) 后，model被封装成DataParallel类中的module。故擅自添加了 model = model.module 后不再报错。
但是用了DataParallel貌似仍然是单卡运行（4块可用）。请问该如何解决？
单卡跑的时候提示 CUDA out of memory，batch_size用了默认的8，单个GPU内存10G，调整为3左右才可顺利跑起来。

AttributeError: 'InputExample' object has no attribute 'target_str'

如题，在/utils/data_utils.py， Line368，传入target_str。但是InputExample没有该字段。

Could you release your code about the Table 2(related to KG) you mentioned in the paper

Couldn't find max_input_len

main.py: Line262__getitem__() -> utils/data_utils.py: self.tokenizer() 传入args.max_input_len并没有在parser中添加。

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.