How to finetune this model about lag-llama HOT 13 CLOSED

coming up after a short recoup! stay tuned. Essentially since its a gluonts Estimator, one should be able to estimator.train() on your data but we need to remove some bespoke fields that were left behind in the lightning callbacks...

from lag-llama.

Yes, as @kashif says, the fine-tuning scripts are coming soon. Scripts to load datasets in custom formats are also coming soon. Thank you for your patience.

from lag-llama.

@zhilif have a look at the colab https://colab.research.google.com/drive/1uvTmh-pe1zO5TeaaRVDdoEWJ5dFDI-pA?usp=sharing

from lag-llama.

@kashif thank you for providing the code. Unfortunately, I got this error during fine-tuning:

TypeError: model must be a LightningModule or torch._dynamo.OptimizedModule, got LagLlamaLightningModule

from lag-llama.

@shahrokhvahabi try to git pull, I believe its somehow running an older code

from lag-llama.

@kashif I deleted the lag-llama and cloned again it from the repository. But this error occurred again.

from lag-llama.

@shahrokhvahabi its due to the newer lightning version you have... so try do to:

!pip uninstall -A gluonts
!pip install -U gluonts[torch]

from lag-llama.

@kashif I did but the error is persistent.

from lag-llama.

ah sorry i meant to say:

!pip uninstall -A lightning pytorch-lightning gluonts
!pip install -U gluonts[torch]

from lag-llama.

ah sorry i meant to say:

!pip uninstall -A lightning pytorch-lightning gluonts
!pip install -U gluonts[torch]

Thank you for the reply @kashif . I did as you mentioned above. Could you please give me another suggestion to avoid this error?

from lag-llama.

yeah not sure what more i can do... somehow your setup is sucking in a newer version of lightning

perhaps

!pip install lightning==2.1.4 pytorch-lightning==2.1.4

from lag-llama.

@kashif Could you please send those files in the model you updated so that I can replace them manually?

from lag-llama.

make a new issue instead of hijacking this one as the original author is getting spammed unnecessarily closing this

from lag-llama.