Ephemeral distributed filesystem build up from the local storage of several nodes. It is an evolution of AdaFS done inside the NGIO project by BSC in collaboration with JGU.
Home Page: https://storage.bsc.es/gitlab/hpc/gekkofs
License: Other
I'm trying to compile GekkoFS on only one node. My question is, is there any minimum requirements that I need to be aware of when installing it (for example, some specific number of nodes, or can it be run on NFS, or does it have to be PFS, etc.)?
[ 63%] Building CXX object src/client/CMakeFiles/gkfs_intercept.dir/gkfs_functions.cpp.o
In file included from /home/chenyx/gekkofs-old/src/client/gkfs_functions.cpp:18:
/home/chenyx/gekkofs-old/include/client/logging.hpp:264:8: error: cannot derive from ‘final’ base ‘fmt::v7::basic_memory_buffer<char, 1024>’ in derived type ‘gkfs::log::static_buffer’
struct static_buffer : public fmt::basic_memory_buffer<char, max_buffer_size> {
^~~~~~~~~~~~~
/home/chenyx/gekkofs-old/include/client/logging.hpp:267:10: error: virtual function ‘virtual void gkfs::log::static_buffer::grow(std::size_t)’ overriding final function
void grow(std::size_t size) override final;
^~~~
In file included from /home/chenyx/gekkofs-old/external/hermes/include/hermes/logging.hpp:16,
from /home/chenyx/gekkofs-old/external/hermes/include/hermes/buffer.hpp:18,
from /home/chenyx/gekkofs-old/external/hermes/include/hermes/exposed_memory.hpp:19,
from /home/chenyx/gekkofs-old/external/hermes/include/hermes/async_engine.hpp:28,
from /home/chenyx/gekkofs-old/external/hermes/include/hermes.hpp:4,
from /home/chenyx/gekkofs-old/include/client/preload_context.hpp:17,
from /home/chenyx/gekkofs-old/include/client/preload.hpp:17,
from /home/chenyx/gekkofs-old/src/client/gkfs_functions.cpp:16:
/home/chenyx/gekkofs-old/external/fmt/include/fmt/format.h:773:6: note: overridden function is ‘void fmt::v7::basic_memory_buffer<T, SIZE, Allocator>::grow(size_t) [with T = char; long unsigned int SIZE = 1024; Allocator = std::allocator; size_t = long unsigned int]’
void basic_memory_buffer<T, SIZE, Allocator>::grow(size_t size) {
Hi
I'm trying to compile GekkoFS. I've tried with cmake versions 3.22 and 3.7. However, when running cmake cmake -DCMAKE_BUILD_TYPE=Release with -DCMAKE_PREFIX_PATH (the directory of my dependencies), I get the following error:
CMake Error at /usr/local/share/cmake-3.7/Modules/FindPackageHandleStandardArgs.cmake:138 (message): Could NOT find Abt (missing: ABT_LIBRARIES ABT_INCLUDE_DIRS) Call Stack (most recent call first): /usr/local/share/cmake-3.7/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE) CMake/FindAbt.cmake:13 (find_package_handle_standard_args) CMakeLists.txt:89 (find_package)
I did a search on the internet but were not able to find anything relate to this ABT_LIBRARIES. Is there any specific library that I should install? Or am I doing something wrong? I would appreciate your help.
I have installed all GekkoFS dependencies and now, after running cmake, when I try to make, I get the following undefined reference error:
[ 66%] Linking CXX executable gkfs_daemon
/opt/rh/devtoolset-8/root/usr/libexec/gcc/x86_64-redhat-linux/8/ld: warning: libabt.so.1, needed by /home/adibi/gekko/install/lib/libmargo.so, may conflict with libabt.so.0
backend/metadata/libmetadata_db.a(merge.cpp.o):(.rodata._ZTIN4gkfs8metadata21MetadataMergeOperatorE[_ZTIN4gkfs8metadata21MetadataMergeOperatorE]+0x10): undefined reference to `typeinfo for rocksdb::MergeOperator'
/home/adibi/gekko/install/lib/libmargo.so: undefined reference to `HG_Addr_lookup2'
/home/adibi/gekko/install/lib/libmargo.so: undefined reference to `hg_proc_checksum_update'
collect2: error: ld returned 1 exit status
make[2]: *** [src/daemon/gkfs_daemon] Error 1
make[1]: *** [src/daemon/CMakeFiles/gkfs_daemon.dir/all] Error 2
make: *** [all] Error 2
I installed margo using spack (and others using the compile_dep.sh script). Could this be the source of the problem? Or should I look elsewhere?
Thanks
Hi.
I'm trying to build GekkoFS. After running dl_dep.sh to download dependencies, I want to install them with compile_dep.sh. However, I get lots of undefined references like this:
src/.libs/libmargo.so: undefined reference to `ABT_xstream_get_main_pools'
src/.libs/libmargo.so: undefined reference to `ABT_thread_yield'
src/.libs/libmargo.so: undefined reference to `HG_Core_ref_get'
src/.libs/libmargo.so: undefined reference to `ABT_eventual_test'
src/.libs/libmargo.so: undefined reference to `ABT_cond_create'
src/.libs/libmargo.so: undefined reference to `ABT_xstream_free'
src/.libs/libmargo.so: undefined reference to `ABT_xstream_join'
src/.libs/libmargo.so: undefined reference to `ABT_thread_join'
src/.libs/libmargo.so: undefined reference to `HG_Registered_data'
src/.libs/libmargo.so: undefined reference to `ABT_eventual_set'
src/.libs/libmargo.so: undefined reference to `ABT_eventual_free'
src/.libs/libmargo.so: undefined reference to `ABT_mutex_lock'
src/.libs/libmargo.so: undefined reference to `ABT_key_create'
src/.libs/libmargo.so: undefined reference to `HG_Get_input_buf'
src/.libs/libmargo.so: undefined reference to `ABT_sched_free'
src/.libs/libmargo.so: undefined reference to `HG_Addr_self'
src/.libs/libmargo.so: undefined reference to `ABT_eventual_create'
src/.libs/libmargo.so: undefined reference to `HG_Addr_to_string'
src/.libs/libmargo.so: undefined reference to `HG_Reset'
src/.libs/libmargo.so: undefined reference to `ABT_cond_free'
src/.libs/libmargo.so: undefined reference to `HG_Deregister'
src/.libs/libmargo.so: undefined reference to `HG_Respond'
src/.libs/libmargo.so: undefined reference to `ABT_xstream_set_main_sched'
src/.libs/libmargo.so: undefined reference to `ABT_key_set'
src/.libs/libmargo.so: undefined reference to `ABT_pool_get_total_size'
src/.libs/libmargo.so: undefined reference to `ABT_cond_wait'
src/.libs/libmargo.so: undefined reference to `HG_Addr_lookup'
src/.libs/libmargo.so: undefined reference to `HG_Trigger'
src/.libs/libmargo.so: undefined reference to `ABT_thread_create'
src/.libs/libmargo.so: undefined reference to `HG_Init_opt'
src/.libs/libmargo.so: undefined reference to `HG_Context_create'
src/.libs/libmargo.so: undefined reference to `HG_Registered'
src/.libs/libmargo.so: undefined reference to `ABT_finalize'
src/.libs/libmargo.so: undefined reference to `ABT_pool_get_size'
src/.libs/libmargo.so: undefined reference to `HG_Bulk_transfer'
src/.libs/libmargo.so: undefined reference to `HG_Context_destroy'
src/.libs/libmargo.so: undefined reference to `HG_Register'
src/.libs/libmargo.so: undefined reference to `ABT_eventual_wait'
src/.libs/libmargo.so: undefined reference to `ABT_xstream_self'
src/.libs/libmargo.so: undefined reference to `HG_Register_data'
src/.libs/libmargo.so: undefined reference to `HG_Bulk_create'
src/.libs/libmargo.so: undefined reference to `ABT_init'
src/.libs/libmargo.so: undefined reference to `HG_Finalize'
src/.libs/libmargo.so: undefined reference to `HG_Addr_free'
src/.libs/libmargo.so: undefined reference to `HG_Registered_disable_response'
src/.libs/libmargo.so: undefined reference to `HG_Destroy'
src/.libs/libmargo.so: undefined reference to `HG_Create'
src/.libs/libmargo.so: undefined reference to `HG_Forward'
src/.libs/libmargo.so: undefined reference to `HG_Addr_dup'
src/.libs/libmargo.so: undefined reference to `HG_Bulk_get_size'
src/.libs/libmargo.so: undefined reference to `ABT_cond_broadcast'
src/.libs/libmargo.so: undefined reference to `make[1]: HG_Registered_disabled_response'
*** [examples/multiplex/margo-example-mp-client] Error 1src/
.libs/libmargo.so: undefined reference to `ABT_thread_free'
src/.libs/libmargo.so: undefined reference to `ABT_xstream_create'
src/.libs/libmargo.so: undefined reference to `HG_Progress'
src/.libs/libmargo.so: undefined reference to `ABT_mutex_free'
src/.libs/libmargo.so: undefined reference to `ABT_mutex_unlock'
src/.libs/libmargo.so: undefined reference to `ABT_pool_create_basic'
src/.libs/libmargo.so: undefined reference to `ABT_sched_create_basic'
src/.libs/libmargo.so: undefined reference to `HG_Bulk_access'
src/.libs/libmargo.so: undefined reference to `ABT_key_get'
src/.libs/libmargo.so: undefined reference to `ABT_mutex_create'
src/.libs/libmargo.so: undefined reference to `HG_Cancel'
src/.libs/libmargo.so: undefined reference to `ABT_cond_signal'
src/.libs/libmargo.so: undefined reference to `ABT_initialized'
src/.libs/libmargo.so: undefined reference to `HG_Registered_proc_cb'
collect2: error: ld returned 1 exit status
make[1]: *** [examples/composition/composed-benchmark] Error 1
make[1]: Leaving directory `/home/adibi/gekko/deps/margo/build'
make: *** [all] Error 2
Why do I get so many undefined reference's? Would appreciate it if you could help me with this.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.