Comments (3)
BasicTS中的Evaluate best model on test data for horizon 96
代表的是在第96个时间片处的损失。而LTSF领域相关工作是预测96个时间片,在这所有的96个时间片上的平均损失。
因此,假如你想要对比预测长度为96时候的结果,你应该先把CFG.DATASET_OUTPUT_LEN
设置为96
,然后查看整个Test Evaluation的结果,即log中长得像这样的行2023-12-10 15:46:42,249 - easytorch-training - INFO - Result <test>: [test_time: 2.93 (s), test_MAE: 3.166884, test_RMSE: 6.541209, test_MAPE: 0.094466, test_WAPE: 0.054826, test_MSE: 42.787418]
。这一行中的就是96个时间片上平均结果。
另外,LTSF的相关研究通常只在归一化后的数值上计算指标。虽然这一设置不太合理,但假如你想要按照这个设置来和他们进行对比,你还需要将CFG.RESCALE
设置成False
。
from basicts.
间
感谢作者大大的回答,那CFG.DATASET_INPUT_LEN需要对应修改么
from basicts.
可以先按照目前仓库中的值复现,差距显著的话就得自己再调整一下了。长序列预测这个领域的输入长度很乱。
from basicts.
Related Issues (20)
- thanks HOT 1
- AGCRN,PEMS08数据集的配置问题 HOT 1
- 请问如何使用inference程序,需要改哪些部分 HOT 15
- Add contributors. HOT 16
- 请问如何修改学习率衰减器 HOT 1
- 修改数据归一化方式。 HOT 1
- MS (multivariate -> univariate)? HOT 2
- 关于数据输入和输出特征个数的问题? HOT 2
- dataloader的droplast问题 HOT 2
- STGCN 模型不能跑第二次 HOT 1
- implementation of spatial indistinguishability HOT 1
- 能否支持early stop? HOT 1
- 您好,请教一下模型训练好后如何获取预测值与真实值的数据 HOT 5
- 怎么快速的修改输入输出长度,完成不同实验? HOT 1
- 关于训练速度 HOT 3
- 如何多卡训练 HOT 2
- 关于给模型增加额外输入的问题 HOT 1
- 关于TrainingMAE与ValidationMAE的大小 HOT 5
- 预测结果可视化时,results为空
- 关于预测结果可视化的问题 HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from basicts.