Comments (3)
Try reprocessing the data as its being loaded from the cache here.
model = ClassificationModel('xlm', 'model/', args=({'fp16': False, 'reprocess_input_data': True'}))
Also, make sure that the model you are loading from model/
was built with the same num_classes
as your data.
from simpletransformers.
It helped thanks!
I am facing another error now:
Converting to features started.
100%|###################################| 560000/560000 [03:49<00:00, 2441.14it/s]
Running loss: 0.724930Traceback (most recent call last): | 0/1 [00:00<?, ?it/s]
File "run1.py", line 24, in | 29999/70000 [1:47:18<2:23:03, 4.66it/s]
model.train_model(train_df)
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/simpletransformers/classification/classification_model.py", line 162, in train_model
global_step, tr_loss = self.train(train_dataset, output_dir, show_running_loss=show_running_loss, eval_df=eval_df)
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/simpletransformers/classification/classification_model.py", line 277, in train
model_to_save.save_pretrained(output_dir_current)
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/transformers/modeling_utils.py", line 204, in save_pretrained
torch.save(model_to_save.state_dict(), output_model_file)
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/serialization.py", line 260, in save
return _with_file_like(f, "wb", lambda f: _save(obj, f, pickle_module, pickle_protocol))
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/serialization.py", line 185, in _with_file_like
return body(f)
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/serialization.py", line 260, in
return _with_file_like(f, "wb", lambda f: _save(obj, f, pickle_module, pickle_protocol))
File "/home/data/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/serialization.py", line 338, in _save
serialized_storages[key]._write_file(f, _should_read_directly(f))
RuntimeError: write(): fd 29 failed with No space left on device
I am using RTX 2080 8 gb. How can I deal with that? Thank you very much for your time and help!
from simpletransformers.
You are running out of storage (HDD/SSD). Clearing some space on your drive should do the trick.
from simpletransformers.
Related Issues (20)
- ValueError: multiclass-multioutput is not supported HOT 6
- save_steps not working , checkpoint getting generated on every epoch morethan once HOT 2
- MMBT no longer supported by huggingface transformers. HOT 1
- Memory Leak Issue HOT 1
- `calculate_results` appears to only use the first correct answer, not all correct answers
- `ValueError` occurred with `representation_model`
- Update of macos to Sonoma 14.0 breaks train_model when using 'mps' device HOT 1
- Convert generate model into .tflite for token classification
- RuntimeError: "nll_loss_forward_reduce_cuda_kernel_2d_index" not implemented for 'Int'
- argmax sliding_window tiebreaker bug
- Error with prediction using multilabel classification
- RoBERTa model Prediction taking Infinite time with no error but Multiprocessing disabled warning
- saving pytorch_model.bin instead of safetensors HOT 1
- Unable to do hyperparamters search on sentence-pair classification(regression) task
- change threshold value in predict for multi-label classification? HOT 1
- Binary classification .predict raises a ValueError: could not broadcast input array from shape (2,2) into shape (1,2) HOT 3
- Problem with the absence of attention_mask when using sliding_window
- Target is multiclass but average='binary'. Please choose another average setting, one of [None, 'micro', 'macro', 'weighted']. HOT 4
- Default learning rate on pretrained layers?
- Loading a fine tuned Seq2Seq MarianMT model gives wrong predictions HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from simpletransformers.