Comments (2)
Impavidity
commented on June 22, 2024
So basically to my observation, there is no direct connection between the exact set match and the validation loss.
Because validation loss is based on the token level (decoding steps), while exact match is based on the whole sequence.
We basically can not tell which checkpoint is better only relying on the validation loss.
Hope this is helpful to you.
from gap-text2sql.
JoaoLages
commented on June 22, 2024
Yes, makes sense. However it is still a bit strange to me how the overfitted model gets picked 😅
from gap-text2sql.
Related Issues (20)
- Query formed for total irrelevant input string HOT 3
- Where is the pre-training data stored, want to know the format of input data. HOT 3
- The code is missing the relogic.logickit file！please ! HOT 2
- Unable to run the notebook or any inference? HOT 5
- Where is the code of pre-training? HOT 2
- How much time will it take to run preprocess step? HOT 2
- Errors in inference on my table HOT 1
- Can we get the pretraining data? HOT 1
- The number of grammar rules (94) is inconsistent with the pre-trained model (97) HOT 1
- Can anyone help out in figuring out what is "terminal" here? HOT 2
- Issue while loading the model HOT 2
- Export to ONNX?
- What are all the steps we need to follow, for our own database
- On clause are missing in inference output HOT 2
- Cannot access model checkpoint HOT 2
- The Criteria-to-SQL dataset
- Can we train our own questions and SQL queries?
- Inferer(infer_config) problem
- ModuleNotFoundError: No module named 'relogic.logickit.dataflow'
- The Google Folders mentioned in the scripts are not available...
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gap-text2sql.