yaserjaradeh / exbert Goto Github PK
View Code? Open in Web Editor NEWexBERT is a transformer-based model able to perform triple classification, predicate prediction, and head entity prediction
License: MIT License
exBERT is a transformer-based model able to perform triple classification, predicate prediction, and head entity prediction
License: MIT License
Hello, Mr.Jaradeh. Sorry to disturb you. I have tried the example how to run UMLS with Sci-BERT on link prediction task, as you mentioned in the README file.
python3 exBERT.py --task htp \
--do_train \
--do_eval \
--do_predict \
--data_dir ./data/UMLS \
--bert_model allenai/scibert_scivocab_uncased \
--max_seq_length 15 \
--train_batch_size 32 \
--learning_rate 5e-5 \
--num_train_epochs 8.0 \
--output_dir ./output_UMLS/ \
--gradient_accumulation_steps 1 \
--eval_batch_size 135 \
--fp16
And I got the following results:
test_loss: 0.8371883630752563
test_simple_accuracy: 0.7947677207483119
test_hits_left_@1: 0.12405446293494705
test_hits_right_@1: 0.12405446293494705
test_hits_@1: 0.12405446293494705
test_hits_left_@3: 0.41603630862329805
test_hits_right_@3: 0.41603630862329805
test_hits_@3: 0.41603630862329805
test_hits_left_@10: 0.9077155824508321
test_hits_right_@10: 0.9077155824508321
test_hits_@10: 0.9077155824508321
test_mean_rank_left: 5.193645990922844
test_mean_rank_right: 5.193645990922844
test_mean_rank: 5.193645990922844
test_mean_reciprocal_rank_left: 0.3445958540911836
test_mean_reciprocal_rank_right: 0.3445958540911836
test_mean_reciprocal_rank: 0.3445958540911836
test_runtime: 16.7289
test_samples_per_second: 1620.012
test_steps_per_second: 3.049
There is somewhat different from the results published in the paper. Is there something wrong with the process I'm running or someplace I forgot to modify?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.