This issue is for tracking the development progress of version 2.0 which is being done in the next branch. Discussion and suggestions are welcomed.

Progress

• C Rewrite
• LZ4 (frame format) support
• Streaming API
• CLI rewrite
• Documentation rewrite
• Finalize archive file format (version 1)

After v2.0 has been released, 1.0 versions will be considered to be completely obsolete. v2.0 will feature no backwards compatibility with v1.0 (and with archive format version 0)

Why?

• Version 1.0 was written in a time when I didn't know much about actually writing good code in C/C++.
• The current C++ API is absolutely ridiculous to use and is specifically engineered for a very specific use case.
  Example: It only supports the use of C++ streams for both reading and writing, and consequently, archives could only be read from a file.
• Bad file format design which leads to extensive usage of heap memory, which needed to be resized frequently while reading, due to the fact that sizing information provided in the file was insufficient.
• I want it to be usable in both C and C++ projects (and steer away from C++ if possible).
• I want it to be less pretentious; I claimed zstd to be the best compression algorithm around and refused to look at any other ones. v2.0 will (hopefully) bring more compression methods to the table, with each of them having a specific advantage for something else (with speed still being the main focus).

when i pass

            if (out_buffer != nullptr && out_size != nullptr) {
                *out_size = sizeof(zpack_u8) * writer.buffer_capacity;
                *out_buffer = (zpack_u8*)malloc(*out_size);
                if (*out_buffer == nullptr) {
                    error_msg_string = "ZPack: Failed to allocate buffer";
                    error_msg = error_msg_string.c_str();
                    return;
                }
                memcpy(*out_buffer, writer.buffer, *out_size);
            }

            int ret;
            if ((ret = zpack_init_reader_memory_shared(&reader, buffer, size))) {
                error_msg_string = "ZPack: Failed to open memory for reading";
                error_msg_string += ", Error: ";
                error_msg_string += zpack_error_to_string(ret);
                error_msg = error_msg_string.c_str();
                return;
            }

i get

archive buffer: 0x7f1d9db49c50
archive size: 2048
ZPack: Failed to open memory for reading, Error: ZPACK_ERROR_SIGNATURE_INVALID