Comments (7)
Great to hear! Thanks!
from tapas.
Hi,
There is a function "_create_examples" which converts interaction protos to TF examples:
Line 193 in a46b790
It is called by run_task_main with --mode="create_data" (here) but that also runs the TSV -> interaction conversion which I'm guessing you don't want. The easiest way might be to just import that function and run it from a notebook or a python script:
from tapas import run_task_main
run_task_main._create_examples(
interaction_dir=INPUT_INTERACTION_DIR,
example_dir=OUTPUT_EXAMPLE_DIR,
vocab_file=VOCAB_FILE,
filename="train",
batch_size=None,
test_mode=False)
run_task_main._create_examples(
interaction_dir=INPUT_INTERACTION_DIR,
example_dir=OUTPUT_EXAMPLE_DIR,
vocab_file=VOCAB_FILE,
filename="dev",
batch_size=EVAL_BATCH_SIZE,
test_mode=False)
run_task_main._create_examples(
interaction_dir=INPUT_INTERACTION_DIR,
example_dir=OUTPUT_EXAMPLE_DIR,
vocab_file=VOCAB_FILE,
filename="eval",
batch_size=EVAL_BATCH_SIZE,
test_mode=False)
This needs the interactions to be in a TFRecords files "${INPUT_INTERACTION_DIR}/train", "${INPUT_INTERACTION_DIR}/dev" and "${INPUT_INTERACTION_DIR}/eval" and outputs TF examples to "${OUTPUT_EXAMPLE_DIR}".
from tapas.
I tried this code :
! python tapas/run_task_main.py
--task="SQA"
--input_dir="${training_data_dir}"
--output_dir="${output_dir}"
--bert_vocab_file="${tapas_data_dir}/vocab.txt"
--mode="create_data"
Got Error :
from tapas.
Looks like the TSV file is not in the right format. Can you share what it looks like?
There seems to be a problem in the answer coordinates column.
from tapas.
Hello,
Issue is resolved, you are right the problem is with the answer coordinates.
Thanks
from tapas.
Hi, The questions in SQA are not tagged with None (when answers are directly from the table) or when they aren't. How is it distinguished?
from tapas.
Can you please tell me exact way of passing the answer coordinates, because I am also facing the same issue.
from tapas.
Related Issues (20)
- Training tables with more than 512 cells HOT 1
- how to train the model on hybridqa and ott-qa
- tapas installation is not working HOT 2
- does it support chinese
- Populate float_answer for Tapas Weak supervision for aggregation (WTQ). TypeError: Parameter to CopyFrom() must be instance of same class: expected language.tapas.Question got str. HOT 2
- The code for TableFormer
- Wrong calculation in table HOT 1
- no issue
- Does anyone know of a Tapas tokenizer that is written in Java, C, or Rust?
- create baseline results
- WQT to SQA format conversion script
- TensorFlow No Matching Distribution Error When Installing 'tapas-table-parsing'
- Sudden Increase in Loss value while finetuning
- Generating Pre-Training Data for TAPAS
- Installation Guide Unavailable on Colab Notebook
- Error: Getting Requirements to Build Wheel Failed HOT 1
- ValueError: Too many rows
- Couldn't find all answers
- Google colab setup.py issue HOT 1
- Files to reproduce QA results of NQ-Tables test set
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tapas.