Comments (5)
@ate47 thank you for this quick fix @KonradHoeffner you can checkout dev compile it and do your tests ....
from hdt-java.
In this class there is already a logger. We can just use this for these messages. The only thing I'm not sure about is if the java command line will not break this way. My best guess is that it is used for that reason.
Can you explain better your use case, I'm still a bit confused why you use the sout to create your CSV. Can you not write to a file?
from hdt-java.
Sure, my use case is taking an existing Benchmark suite for RDF libraries without HDT and extending it with measurements of RDF libraries with HDT because we are writing an HDT library in Rust and want to know how it compares in performance to the existing libraries both with and without HDT.
If you are interested, you can see the plots for the Jupyter Notebook here.
Because the libraries use many different programming languages, the benchmark is structured like this:
There is a python program that recognizes different tools and tasks, and depending on the tool and task selected, it runs this tool, which is in one of the subfolders, and runs it multiple times for each dataset size. The benchmarking subprogram for that tool in that subfolder responds with printing one line of CSV output to stdout and the Python program merges all those together in one CSV file for each tool.
Then you can start Juypter Lab and generate the plots and see the scores.
I could modify everything to use Files instead but it would be a large amount of refactoring and does not fit well because each program is run many times and the benchmarking suite combines all the different results.
P.S.: Oh hi Dennis, it seems you are everywhere :-)
from hdt-java.
an HDT implementation in Rust 😍 (so also python?)
from hdt-java.
@mielvds: Yes! I was looking for an HDT library for Rust last year and was surprised that there wasn't any on crates.io. However @timplication had one on GitHub and he allowed me to continue it under an open license.
You can try it at https://github.com/konradhoeffner/hdt or find it https://crates.io/crates/hdt.
It's still under development though and doesn't have all the functions of the CPP and Java versions, i.e. only the default triple order and default HDT variant.
But all the triple pattern querying and the indexes are there.
I haven't directly interfaced Rust with Python though, the Python script just executes the binary.
from hdt-java.
Related Issues (20)
- Can we make HDTCat work under windows? HOT 2
- Problem in hdtCat when compressing on small machine or many literals HOT 1
- Filter doesn't appear to be working with Jena interface HOT 4
- OPS indexing HOT 3
- Dependency org.apache.commons:commons-compress, leading to CVE problem HOT 1
- Increment HDT and index version to 3.0.0 HOT 6
- Release version 2.2 HOT 2
- Setup Github Action for Maven release HOT 18
- IllegalFormatException or IllegalArgumentException while reading RDF with B-Nodes in two-pass mode
- the ByteStringUtil.longestCommonPrefix(...) method isn't working between non ascii String and internal CharSequence
- Support query of multiple HDT files from CLI HOT 3
- Can't use Big version of the sequence HOT 1
- Fuseki integration seems broken since 3.0.0 HOT 4
- Byte strings aren't able to compare UTF32 strings
- Unsafe memory access HOT 2
- Question about Bitmap Triples Iterator ZFOQ implementation HOT 5
- Required array length 2147483639 + 11 is too large HOT 4
- Filtering issue HOT 3
- Problem loading wikidata: java.lang.OutOfMemoryError: Requested array size exceeds VM limit HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hdt-java.