fomy / destor Goto Github PK

gcc -g -O0 -Wall -o destor src/libdestor.a src/index/libindex.a src/storage/libstorage.a src/utils/libutils.a src/recipe/librecipe.a src/chunking/libchunk.a src/fsl/libfsl.a -lpthread -lcrypto -lglib
/usr/bin/ld: src/libdestor.a(jcr.o):/home/cyf/destor/src/destor.h:281: multiple definition of destor'; src/libdestor.a(destor.o):/home/cyf/destor/src/destor.h:281: first defined here /usr/bin/ld: src/libdestor.a(config.o):/home/cyf/destor/src/destor.h:281: multiple definition of destor'; src/libdestor.a(destor.o):/home/cyf/destor/src/destor.h:281: first defined here
/usr/bin/ld: src/libdestor.a(do_backup.o):/home/cyf/destor/src/destor.h:281: multiple definition of destor'; src/libdestor.a(destor.o):/home/cyf/destor/src/destor.h:281: first defined here /usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/destor.h:281: multiple definition of destor'; src/libdestor.a(destor.o):/home/cyf/destor/src/destor.h:281: first defined here
/usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/backup.h:60: multiple definition of read_queue'; src/libdestor.a(do_backup.o):/home/cyf/destor/src/backup.h:60: first defined here /usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/backup.h:62: multiple definition of chunk_queue'; src/libdestor.a(do_backup.o):/home/cyf/destor/src/backup.h:62: first defined here
/usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/backup.h:64: multiple definition of hash_queue'; src/libdestor.a(do_backup.o):/home/cyf/destor/src/backup.h:64: first defined here /usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/backup.h:66: multiple definition of trace_queue'; src/libdestor.a(do_backup.o):/home/cyf/destor/src/backup.h:66: first defined here
/usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/backup.h:68: multiple definition of dedup_queue'; src/libdestor.a(do_backup.o):/home/cyf/destor/src/backup.h:68: first defined here /usr/bin/ld: src/libdestor.a(read_phase.o):/home/cyf/destor/src/backup.h:70: multiple definition of rewrite_queue'; src/libdestor.a(do_backup.o):/home/cyf/destor/src/backup.h:70: first defined here
/usr/bin/ld: src/libdestor.a(chunk_phase.o):/home/cyf/destor/src/destor.h:281: multiple definition of `destor'; src/libdestor.a(destor.o):/home/cyf/destor/src/destor.h:281: first defined here
......

When run the configure file, I get an error like this……

checking for SHA_Update in -lcrypto... no
configure: error: *** Working crypto library not found ***

I am sure that I had installed the libssl-dev

Because i use the latest crypto lib, so i need to change all the SHA_Update in the source code to SHA1_Update, so as to pass the configure file check, but when i make, the shell:
CDPATH="${ZSH_VERSION+.}:" && cd . && aclocal-1.14
/bin/bash: line 1: aclocal-1.14: command not found
make: *** [Makefile:339: aclocal.m4] Error 127

I'm trying to use the tool but glib is giving me a headache. I've tried installing from Ubuntu Xenial repository, latest glib from source and 2.32 from source, none worked, ./configure still says it can't find glib.h. Issue @3 didn't help.

Copying the .so solved the first error (glib not found), but even after copying the .h files to /usr/local/include I still get: configure: error: *** Working glib.h header not found ***

How can I fix this?
Thank you.

Thank you for sharing the Destor platform publicly. I'm trying to use Destor for my research in deduplication and I have a small problem related to the glib directory. I installed libglib3-dev but I am still having an error when trying to run the configuration file. I copied the header file to /usr/local/include with no luck.

Could you please tell me what should I do to fix this.

Thanks

Hi Min,

I noticed that har_rewrite algorithm will always be called, even when I set rewrite_algorithm to "no" in the configuration file. Have you considered to disable it for such cases? I tried to ingest 1024 commoncrawl wet files into destor with 1K average chunk size and it took almost 2 days. thanks,

-Xing