Comments (5)
Hey men, I encounter the same issue. Are you able to resolve it?
I keep getting this,
OP_REQUIRES failed at cwise_ops_common.cc:70 : Resource exhausted: OOM when allocating tensor with shape[768,768].
I already reduce the batch size to 3 but didn't work.
from bert4doc-classification.
Hi,
first, thank u for having sharing ur cod with us
I am trying to further pretraining a bert model on my own corpus on colab gpu but I am getting an error of resource exhausted
can someone tell me how to fix thisAlso what are the expected output of this further pretraining
Are they the bert tenserflow files that we can use for fine-tuning ( checkpoint, config, and vocab)?Thank u
sorry for the late answer!
i am not very familiar with tensorflow, but there are some suggestions:
- check the version of tensorflow and make sure it is 1.1x
- if it has OOM problems, please reduce your batch size or reduce your max sequence length. the official bert repo has provided an example:
- we do not have some resources for fine-tuning with tensorflow, you can check from the official bert repo if you want
from bert4doc-classification.
Hey men, I encounter the same issue. Are you able to resolve it?
I keep getting this,
OP_REQUIRES failed at cwise_ops_common.cc:70 : Resource exhausted: OOM when allocating tensor with shape[768,768].
I already reduce the batch size to 3 but didn't work.
sorry for the late answer!
if you have OOM problems, please reduce your batch size and max sequence length
the official bert repo has provided some example with a 12G GPU
from bert4doc-classification.
Hi,
thank u for answering
I reduced the train_batch_size to 8 and max_seq_length to 40
but I still get the resource exhausted error
I am running the code on colab gpu 12G RAM
any ideas plz
thank u
from bert4doc-classification.
Hi,
thank u for answering
I reduced the train_batch_size to 8 and max_seq_length to 40
but I still get the resource exhausted error
I am running the code on colab gpu 12G RAM
any ideas plzthank u
as your description:
does your model contain some other NN modules?
does your colab gpu need to share with others?
do you have enough cpu sources (e.g., it is cpu OOM but not gpu OOM)?
from bert4doc-classification.
Related Issues (20)
- save_checkpoints_steps doesnt work. HOT 1
- For Layer-wise Decreasing Layer Rate HOT 1
- OOM when batchSize=1 HOT 3
- Further Pre-Training on the IMDB dataset HOT 1
- further pre-training HOT 1
- further-pretraining HOT 1
- python version HOT 3
- hight perplexity when Further Pre-Training HOT 1
- eval only for imdb sentiment classification
- 希望出个中文版readme HOT 1
- 0 instances wrote while further pre-training on my own dataset HOT 1
- Generate Further Pre-Training Corpus HOT 1
- Bert中的Embedding Layer HOT 1
- How to fine tuning model on multi-tasks? HOT 3
- How much time did it take to run the further pre-training step? HOT 1
- Questions about discriminative_fine_tuning HOT 2
- Question about Further Pre-training
- max_sequence_length in create_pretraining_data HOT 2
- Validation dataset split HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bert4doc-classification.