opendataio / hcfsfuse Goto Github PK
View Code? Open in Web Editor NEWLicense: Apache License 2.0
License: Apache License 2.0
Describe
In the scenario of reading a 300MB file from cos,fnifuse takes 30s, but fnrfuse takes 12s
Fix #13050
As the README.md said, after
mvn clean package
command, hcfsfuse--jar-with-dependencies.jar was generated in the folder target.
However, when I try
$ java -jar target/hcfsfuse-1.0.0-SNAPSHOT-jar-with-dependencies.jar -c core-site.xml -c another-site.xml -m /Users/mbl/fusefs -r https://fuse-optimize-xxx.cos.ap-chengdu.myqcloud.com
, in which the url is the address of COS bucket. There occurs ERRORS:
[main] WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable [main] INFO fuse.HCFSFuse (HCFSFuse.java:main) - mounting to /Users/mbl/fusefs [Thread-6] ERROR fuse.AlluxioFuseUtils (AlluxioFuseUtils.java:getIdInfo) - Failed to get id from with option -u [Thread-6] ERROR fuse.AlluxioFuseUtils (AlluxioFuseUtils.java:getGidFromGroupName) - Failed to get gid from group name .
while the process is NOT interrupted, the shell is stuck and finally the connection to server shutdown.
How can I solve this problem? Is something wrong with the URL of my COS or the access authority need to be changed?
I have a S3 bucket and I want to use hcfsfuse to mount a local directory to the bucket.
But I can't find the way to this thing. Please give me some help.
Thank you
Thanks for your great work!
I have few questions on it.
I think there is no need to import spring related dependencies.
Why not using maven shade plugin. Because when i use hcfsuse to mount hdfs, found that i can't get the hdfs filesystem through Java SPI. related question: https://stackoverflow.com/questions/17265002/hadoop-no-filesystem-for-scheme-file. When i refactor the way of packaging, it works well.
jar /tmp/hcfsfuse-1.0.0-SNAPSHOT.jar -m /tmp/m3 -r hdfs://XXXX
ls /tmp
and i got:
d????????? ? ? ? ? ? m3
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.