Source code of the proposed models and experiments in the paper "[OKGIT: Open Knowledge Graph Link Prediction with Implicit Types]()" to be presented in the Findings of ACL 2021.
License: MIT License
What is the time for open source code
When generating single token datasets, whether to choose bert-base-uncased-vocab.txt or bert-large-uncased-vocab.txt will affect the result. And what are your options（--bert-vocab） for building ReVerb20KF and ReVerb45KF.
My ReVerb45KF built with bert-large-uncased-vocab.txt results in poor performance. I am using the parameters you gave.
2023-02-27 21:14:16,082 - [INFO] - epoch 1/500 total epochs, epoch_loss: 0.0034277710226287535
2023-02-27 21:14:31,179 - [INFO] - epoch 2/500 total epochs, epoch_loss: 0.002699810571524255
2023-02-27 21:14:45,655 - [INFO] - epoch 3/500 total epochs, epoch_loss: 0.002502651752716084
2023-02-27 21:15:00,741 - [INFO] - epoch 4/500 total epochs, epoch_loss: 0.0023357097845558726
2023-02-27 21:15:15,439 - [INFO] - epoch 5/500 total epochs, epoch_loss: 0.0022172728818285904
0.218080 238.766129 0.135484 0.239785 0.388172
2023-02-27 21:15:16,669 - [INFO] - Best Valid MRR: 0.21808036768978079, Best Valid MR: 238.76612903225805, Best Epoch: 5
2023-02-27 21:15:31,130 - [INFO] - epoch 6/500 total epochs, epoch_loss: 0.002129367122281377
2023-02-27 21:15:46,049 - [INFO] - epoch 7/500 total epochs, epoch_loss: 0.002052725458286976
2023-02-27 21:16:00,582 - [INFO] - epoch 8/500 total epochs, epoch_loss: 0.0019862243602342834
2023-02-27 21:16:16,472 - [INFO] - epoch 9/500 total epochs, epoch_loss: 0.0019248791269684603
2023-02-27 21:16:31,726 - [INFO] - epoch 10/500 total epochs, epoch_loss: 0.001867857580115899
0.245991 208.730645 0.156452 0.272581 0.429570
2023-02-27 21:16:34,370 - [INFO] - Best Valid MRR: 0.24599121566721965, Best Valid MR: 208.73064516129034, Best Epoch: 10
2023-02-27 21:16:50,547 - [INFO] - epoch 11/500 total epochs, epoch_loss: 0.0018030836998801166
2023-02-27 21:17:05,124 - [INFO] - epoch 12/500 total epochs, epoch_loss: 0.001751775239218334
2023-02-27 21:17:19,634 - [INFO] - epoch 13/500 total epochs, epoch_loss: 0.001697675712671507
2023-02-27 21:17:34,541 - [INFO] - epoch 14/500 total epochs, epoch_loss: 0.0016481651296548613
2023-02-27 21:17:49,925 - [INFO] - epoch 15/500 total epochs, epoch_loss: 0.0015984452671345768
0.266008 210.350538 0.172043 0.303226 0.455376
2023-02-27 21:17:51,483 - [INFO] - Best Valid MRR: 0.26600811430414495, Best Valid MR: 208.73064516129034, Best Epoch: 15
2023-02-27 21:18:06,119 - [INFO] - epoch 16/500 total epochs, epoch_loss: 0.0015467402414170975
2023-02-27 21:18:21,000 - [INFO] - epoch 17/500 total epochs, epoch_loss: 0.0014969155153926085
2023-02-27 21:18:35,600 - [INFO] - epoch 18/500 total epochs, epoch_loss: 0.0014493977640319719
2023-02-27 21:18:50,090 - [INFO] - epoch 19/500 total epochs, epoch_loss: 0.0014140228367060287
2023-02-27 21:19:04,475 - [INFO] - epoch 20/500 total epochs, epoch_loss: 0.0013603060837373685
0.278762 213.265054 0.182258 0.320430 0.462366
2023-02-27 21:19:06,029 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:19:21,025 - [INFO] - epoch 21/500 total epochs, epoch_loss: 0.0013205463370017775
2023-02-27 21:19:35,946 - [INFO] - epoch 22/500 total epochs, epoch_loss: 0.0012791187325150732
2023-02-27 21:19:50,401 - [INFO] - epoch 23/500 total epochs, epoch_loss: 0.0012451123773043445
2023-02-27 21:20:05,160 - [INFO] - epoch 24/500 total epochs, epoch_loss: 0.0012028574144655685
2023-02-27 21:20:20,527 - [INFO] - epoch 25/500 total epochs, epoch_loss: 0.001176465008997384
0.276271 215.196237 0.184409 0.309140 0.464516
2023-02-27 21:20:21,577 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:20:35,883 - [INFO] - epoch 26/500 total epochs, epoch_loss: 0.0011421280534972154
2023-02-27 21:20:50,448 - [INFO] - epoch 27/500 total epochs, epoch_loss: 0.0011116319128799193
2023-02-27 21:21:05,157 - [INFO] - epoch 28/500 total epochs, epoch_loss: 0.0010801680522774337
2023-02-27 21:21:20,513 - [INFO] - epoch 29/500 total epochs, epoch_loss: 0.0010528758161812337
2023-02-27 21:21:34,987 - [INFO] - epoch 30/500 total epochs, epoch_loss: 0.0010284161907535285
0.276700 220.167204 0.185484 0.310753 0.462366
2023-02-27 21:21:35,984 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:21:50,450 - [INFO] - epoch 31/500 total epochs, epoch_loss: 0.0009890215048446842
2023-02-27 21:22:05,288 - [INFO] - epoch 32/500 total epochs, epoch_loss: 0.0009724375211907157
2023-02-27 21:22:20,218 - [INFO] - epoch 33/500 total epochs, epoch_loss: 0.0009439654131377235
2023-02-27 21:22:34,775 - [INFO] - epoch 34/500 total epochs, epoch_loss: 0.0009263524066853346
2023-02-27 21:22:49,206 - [INFO] - epoch 35/500 total epochs, epoch_loss: 0.0009063599073678392
0.273163 222.205376 0.182258 0.305914 0.446774
2023-02-27 21:22:50,210 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:23:04,907 - [INFO] - epoch 36/500 total epochs, epoch_loss: 0.0008400144395119416
2023-02-27 21:23:19,424 - [INFO] - epoch 37/500 total epochs, epoch_loss: 0.0008025701652246809
2023-02-27 21:23:33,912 - [INFO] - epoch 38/500 total epochs, epoch_loss: 0.0007793185965440005
2023-02-27 21:23:48,329 - [INFO] - epoch 39/500 total epochs, epoch_loss: 0.0007664803917511204
2023-02-27 21:24:03,113 - [INFO] - epoch 40/500 total epochs, epoch_loss: 0.0007443438746556298
0.273510 220.288710 0.187634 0.297312 0.447849
2023-02-27 21:24:04,160 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:24:18,888 - [INFO] - epoch 41/500 total epochs, epoch_loss: 0.000733277220022651
2023-02-27 21:24:33,541 - [INFO] - epoch 42/500 total epochs, epoch_loss: 0.0007201894554907644
2023-02-27 21:24:48,659 - [INFO] - epoch 43/500 total epochs, epoch_loss: 0.0007074993956030918
2023-02-27 21:25:03,404 - [INFO] - epoch 44/500 total epochs, epoch_loss: 0.0006973605385101443
2023-02-27 21:25:18,262 - [INFO] - epoch 45/500 total epochs, epoch_loss: 0.0006895613084427603
0.275259 222.013978 0.190860 0.303763 0.439247
2023-02-27 21:25:19,248 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:25:34,258 - [INFO] - epoch 46/500 total epochs, epoch_loss: 0.0006735949406460132
2023-02-27 21:25:48,543 - [INFO] - epoch 47/500 total epochs, epoch_loss: 0.000667945594514011
2023-02-27 21:26:01,728 - [INFO] - epoch 48/500 total epochs, epoch_loss: 0.0006647816321966367
2023-02-27 21:26:15,413 - [INFO] - epoch 49/500 total epochs, epoch_loss: 0.0006565068845227019
2023-02-27 21:26:30,335 - [INFO] - epoch 50/500 total epochs, epoch_loss: 0.0006472916057153922
0.269283 228.400000 0.180108 0.302688 0.433871
2023-02-27 21:26:31,397 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:26:45,784 - [INFO] - epoch 51/500 total epochs, epoch_loss: 0.0006155206206673329
2023-02-27 21:27:00,327 - [INFO] - epoch 52/500 total epochs, epoch_loss: 0.0006019571871355757
2023-02-27 21:27:15,451 - [INFO] - epoch 53/500 total epochs, epoch_loss: 0.0005983283803071998
2023-02-27 21:27:30,466 - [INFO] - epoch 54/500 total epochs, epoch_loss: 0.0005970319632628779
2023-02-27 21:27:45,000 - [INFO] - epoch 55/500 total epochs, epoch_loss: 0.000586473387014548
0.270632 225.382796 0.184409 0.300000 0.431720
2023-02-27 21:27:46,035 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:28:01,408 - [INFO] - epoch 56/500 total epochs, epoch_loss: 0.0005794703373535955
2023-02-27 21:28:16,035 - [INFO] - epoch 57/500 total epochs, epoch_loss: 0.0005703919477453199
2023-02-27 21:28:30,905 - [INFO] - epoch 58/500 total epochs, epoch_loss: 0.0005675582268591457
2023-02-27 21:28:45,569 - [INFO] - epoch 59/500 total epochs, epoch_loss: 0.0005662578180509217
2023-02-27 21:29:00,221 - [INFO] - epoch 60/500 total epochs, epoch_loss: 0.0005641671518662756
0.270086 227.131183 0.184946 0.297849 0.436022
2023-02-27 21:29:01,275 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:29:15,935 - [INFO] - epoch 61/500 total epochs, epoch_loss: 0.0005590448061478486
2023-02-27 21:29:31,273 - [INFO] - epoch 62/500 total epochs, epoch_loss: 0.0005493072329362461
2023-02-27 21:29:46,684 - [INFO] - epoch 63/500 total epochs, epoch_loss: 0.0005457527981430224
2023-02-27 21:30:01,775 - [INFO] - epoch 64/500 total epochs, epoch_loss: 0.0005449565766174175
2023-02-27 21:30:16,248 - [INFO] - epoch 65/500 total epochs, epoch_loss: 0.0005400527144222597
0.268064 227.482258 0.182258 0.298925 0.430108
2023-02-27 21:30:17,292 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:30:31,699 - [INFO] - epoch 66/500 total epochs, epoch_loss: 0.0005273957514639841
2023-02-27 21:30:47,084 - [INFO] - epoch 67/500 total epochs, epoch_loss: 0.0005232504645892239
2023-02-27 21:31:02,330 - [INFO] - epoch 68/500 total epochs, epoch_loss: 0.0005203833754939121
2023-02-27 21:31:17,956 - [INFO] - epoch 69/500 total epochs, epoch_loss: 0.0005139645854963861
2023-02-27 21:31:32,872 - [INFO] - epoch 70/500 total epochs, epoch_loss: 0.000511679196796474
0.270010 230.236022 0.185484 0.301075 0.427957
2023-02-27 21:31:33,938 - [INFO] - Best Valid MRR: 0.2787624563729776, Best Valid MR: 208.73064516129034, Best Epoch: 20
2023-02-27 21:31:33,980 - [INFO] - Test Set Evaluation ---
0.263959 215.694703 0.177165 0.294202 0.434145
Can you give me some guidance？ I would be very grateful if you could take the time to answer my questions. Sorry for wasting your time.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.