louishenrifranc / attention Goto Github PK
View Code? Open in Web Editor NEWAttention is All You Need in Sonnet
Home Page: https://louishenrifranc.github.io/techblog/2017/08/25/attention/
Attention is All You Need in Sonnet
Home Page: https://louishenrifranc.github.io/techblog/2017/08/25/attention/
Could you consider releasing the code under open source licenses such as MIT? Thanks.
sudo apt install python-pip
pip install tensorflow
pip install dm-sonnet
pip install tqdm
pip install numpy
git clone https://github.com/louishenrifranc/attention.git
cd attention
./run_micro_services.sh
Gives:
$ ./run_micro_services.sh
Experiment will be run without saving current version of the code/config
Running Task Data Generation
Traceback (most recent call last):
File "attention/services/create_copy_task/create_copy_task.py", line 1, in <module>
from tqdm import trange
ModuleNotFoundError: No module named 'tqdm'
Run Task Data Generation
Run Attention Traininig
Traceback (most recent call last):
File "attention/services/attention_train/attentiontrain.py", line 6, in <module>
from attention.utils.config import AttrDict, RunConfig
ModuleNotFoundError: No module named 'attention'
So tried:
sudo apt install python3-tqdm
sudo apt install python3-numpy
But then get:
$ ./run_micro_services.sh
Experiment will be run without saving current version of the code/config
Running Task Data Generation
Traceback (most recent call last):
File "attention/services/create_copy_task/create_copy_task.py", line 9, in <module>
from attention.utils.config import AttrDict
ModuleNotFoundError: No module named 'attention'
Run Task Data Generation
Run Attention Traininig
Traceback (most recent call last):
File "attention/services/attention_train/attentiontrain.py", line 6, in <module>
from attention.utils.config import AttrDict, RunConfig
ModuleNotFoundError: No module named 'attention'
OS: Ubuntu Bionic.
Any ideas?
Experiment will be run without saving current version of the code/config
Running Task Data Generation
100%|######################################################################################| 200000/200000 [00:22<00:00, 8875.19it/s]
100%|########################################################################################| 30000/30000 [00:03<00:00, 8611.42it/s]
Run Task Data Generation
Run Attention Traininig
INFO:tensorflow:Using config: {'_model_dir': 'transformer_output/model', '_tf_random_seed': None, '_save_summary_steps': 500, '_save_checkpoints_steps': 500, '_save_checkpoints_secs': None, '_session_config': None, '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_service': None, '_cluster_spec': <tensorflow.python.training.server_lib.ClusterSpec object at 0x7facaa92ce48>, '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1, 'environment': None}
Traceback (most recent call last):
File "attention/services/attention_train/attentiontrain.py", line 83, in <module>
TrainAttention(**args).main()
File "attention/services/attention_train/attentiontrain.py", line 56, in main
self.train_and_evaluate(model=model)
File "attention/services/attention_train/attentiontrain.py", line 71, in train_and_evaluate
validation_answer_filename=os.path.join(self.datasets.valid_data_dir, "answer.txt"))
File "/attention/attention/algorithms/transformer/transformer.py", line 68, in train_and_evaluate
max_sequence_len=train_params["max_sequence_len"])
KeyError: 'max_sequence_len'
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.