polardb / polardbx-engine Goto Github PK

polardbx-engine is a MySQL branch originated from Alibaba Group, especially supports large-scale distributed database system.

License: Other

CMake 0.64% Shell 0.39% C++ 64.61% C 19.64% Batchfile 0.01% Objective-C 0.46% Perl 2.55% CSS 1.24% CoffeeScript 0.01% Makefile 0.19% JavaScript 8.68% HTML 0.30% Python 0.43% sed 0.01% Roff 0.02% Starlark 0.04% M4 0.05% NASL 0.74% SAS 0.01% DIGITAL Command Language 0.01%

mysql polardb-x

polardbx-engine's People

Contributors

Stargazers

Watchers

Forkers

xpchild lin848497337 weicao breadchen jackichen zdsppl chuckcai agapple pyson dingfeng lianhuiwang db-extreme ezhangle huster-ljw anysql devillove084 pippo1980 twicoder renwohei sintef-xx xiaoyong-z jerousrb woqutech shgxwxl liuhuanting laashub-soa metavai zhaodiankui iyupeng crazynash xtcyclist qlw xieyubo2000 strongduanmu ufoxd allenads xiaoshengmr ystaticy justbk2015 dovoid mark15217 strikew leeworker cnut chinweorg ihavec lemei20002 ztelur tennyzhuang ruixiangma limengcanyu guzhouke benguang wcf2333 zjx1230 yingchengjun shujauddinrahimi mu-l dut3062796s joecarf databaseservice jiekertime tide999 bidutech striver619 photon8231 taoterrrr zexuan misselvexu terry1504 guoxiangcn ringsc zhshw og-max indiff awesomedatatool jingjunli shengliang he-xiaolong datadreamer01 hugheszi warmchang qinggeng36 abdiiwan1841 rohankumardubey tangguoqiang172528725 cslilong awesomedatatool sunxm123 adofsauron githubfzx andrewrong bugxia konghaiya nliver hustjieke xuyue-deng feiniaofeiafei harpsealcc web-logs2

polardbx-engine's Issues

xengine主键range条件查询性能非常差

表结构，造100w行数据
CREATE TABLE sbtest1(idint(11) NOT NULL AUTO_INCREMENT,kint(11) NOT NULL DEFAULT '0',cvarchar(4096) COLLATE utf8mb4_general_ci NOT NULL DEFAULT '',pad char(60) COLLATE utf8mb4_general_ci NOT NULL DEFAULT '', PRIMARY KEY (id), KEY k_1 (k) ) ENGINE=XENGINE

简单的查询

同样表结构和数据，换成innodb没有问题

x-engine run db_bench coredump

I want to run the x-engine db_bench alone.

BUILD

git clone https://github.com/ApsaraDB/galaxyengine.git
cd galaxyengine/storage/xengine/core
sh build.sh -t release -g asan

RUN

./db_bench - coredump

xengine::tools::Benchmark::OpenDb (this=this@entry=0x7fffffffca70, options=..., db_name=..., db=db@entry=0x7fffffffcaa8) at /media/ssd2/zhanghuigui/galaxyengine/storage/xengine/core/tools/db_bench_tool.cc:4035
4035            db->cfh.push_back(dbimpl->DefaultColumnFamily());
Missing separate debuginfos, use: debuginfo-install libaio-0.3.109-13.el7.x86_64 libgcc-4.8.5-39.el7.x86_64
(gdb) bt
#0  xengine::tools::Benchmark::OpenDb (this=this@entry=0x7fffffffca70, options=..., db_name=..., db=db@entry=0x7fffffffcaa8) at /galaxyengine/storage/xengine/core/tools/db_bench_tool.cc:4035
#1  0x0000000000655699 in xengine::tools::Benchmark::InitializeOptionsGeneral (this=this@entry=0x7fffffffca70, opts=opts@entry=0x7fffffffcb68)
    at /galaxyengine/storage/xengine/core/tools/db_bench_tool.cc:3967
#2  0x0000000000656c49 in xengine::tools::Benchmark::Open (opts=0x7fffffffcb68, this=0x7fffffffca70) at /galaxyengine/storage/xengine/core/tools/db_bench_tool.cc:3987
#3  xengine::tools::Benchmark::Run (this=this@entry=0x7fffffffca70) at /galaxyengine/storage/xengine/core/tools/db_bench_tool.cc:2932
#4  0x00000000006252b9 in xengine::tools::db_bench_tool (argc=<optimized out>, argv=<optimized out>) at /galaxyengine/storage/xengine/core/tools/db_bench_tool.cc:7773
#5  0x00007ffff6945c05 in __libc_start_main () from /lib64/libc.so.6
#6  0x00000000005f595e in _start ()

[suggestion] the source installation guild of galaxyengine should not be placed in another project

Now the source installation guide of THIS repository is placing in ANOTHER repository which is neither a conclusive repository(PolarDB-X e.g.) nor a document-only repostiory(galaxyengine-doc e.g.).

Now the way is really counterintuitive, make me confused in the fighting with compilation. For you my friend, I'm afraid that it will be a tar pit for your management in the future.

I suggest to immediately have your documents enclosed in its desire repostiory. And if you can, place all documents in a document focused repository like javadoc or go/website will be more preferable.

Hope you can take this in consideration.

使用rpm搭建集群无法启动

rpm t-polardbx-engine-2.3.0-b959577.el7.x86_64.rpm

初始化

/opt/polardbx_engine/bin/mysqld --defaults-file=/home/my.cnf --cluster-info='192.168.110.102:14886;192.168.110.103:14886;192.168.110.104:14886;@1' --initialize-insecure

启动

/opt/polardbx_engine/bin/mysqld_safe --defaults-file=/home/my.cnf --cluster-info='192.168.110.102:14886;192.168.110.103:14886;192.168.110.104:14886;@1' &

报错日志

2024-03-24T06:38:52.702808Z 0 [System] [MY-010116] [Server] /opt/polardbx_engine/bin/mysqld (mysqld 8.0.30) starting as process 18898
2024-03-24T06:38:52.702846Z 0 [ERROR] [MY-010338] [Server] Can't find error-message file '/opt/polardbx-engine/share/errmsg.sys'. Check error-message file location and 'lc-messages-dir' configuration directive.
2024-03-24T06:38:53.852884Z 1 [Warning] [MY-011825] [InnoDB] [GTID INFO] Reading from undo log :
2024-03-24T06:38:54.347355Z 0 [Warning] [MY-000000] [Server] Plugin polarx_rpc reported: 'polarx_rpc start up'
2024-03-24T06:38:54.347718Z 0 [ERROR] [MY-000000] [Server] Plugin polarx_rpc reported: 'PolarX RPC disabled.'
2024-03-24T06:38:54.365399Z 0 [System] [MY-010229] [Server] Starting crash recovery...
2024-03-24T06:38:54.371373Z 0 [System] [MY-010232] [Server] Crash recovery finished.
2024-03-24T06:38:54.371621Z 0 [Warning] [MY-000000] [Server] Recover consensus index is 0
2024-03-24T06:38:54.563981Z 0 [Warning] [MY-000000] [Server] gtid_mode is GTID_MODE_ON, turn on recovery_apply_binlog
2024-03-24T06:38:54.566028Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
terminate called after throwing an instance of 'std::out_of_range'
what(): basic_string::at: __n (which is 18446744073709551613) >= this->size() (which is 0)
06:38:54 UTC - mysqld got signal 6 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.
Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0 thread_stack 0x46000
/opt/polardbx_engine/bin/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0x2e) [0x2018e4e]
/opt/polardbx_engine/bin/mysqld(handle_fatal_signal+0x2f3) [0x10a4363]
/lib64/libpthread.so.0(+0xf630) [0x7f5ffeb8e630]
/lib64/libc.so.6(gsignal+0x37) [0x7f5ffd737387]
/lib64/libc.so.6(abort+0x148) [0x7f5ffd738a78]
/lib64/libstdc++.so.6(__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f5ffde317d5]
/lib64/libstdc++.so.6(+0x5e746) [0x7f5ffde2f746]
/lib64/libstdc++.so.6(+0x5e773) [0x7f5ffde2f773]
/lib64/libstdc++.so.6(+0x5e993) [0x7f5ffde2f993]
/opt/polardbx_engine/bin/mysqld(std::__throw_out_of_range_fmt(char const*, ...)+0x107) [0x2ab6e57]
/opt/polardbx_engine/bin/mysqld(alisql::StableConfiguration::initServerFromString(std::shared_ptralisql::Server, std::string, bool)+0x35) [0x29e05b5]
/opt/polardbx_engine/bin/mysqld(alisql::StableConfiguration::installConfig(std::vector<std::string, std::allocatorstd::string > const&, unsigned long, alisql::Paxos*, std::shared_ptralisql::LocalServer)+0x3ef) [0x29e237f]
/opt/polardbx_engine/bin/mysqld(alisql::Paxos::init(std::vector<std::string, std::allocatorstd::string > const&, unsigned long, alisql::ClientService*, unsigned long, unsigned long, std::shared_ptralisql::LocalServer, bool, unsigned long)+0xb5a) [0x29ba7aa]
/opt/polardbx_engine/bin/mysqld(ConsensusLogManager::init_service()+0xf69) [0x1c7ea89]
/opt/polardbx_engine/bin/mysqld(init_binlog()+0x44) [0xe21e64]
/opt/polardbx_engine/bin/mysqld(mysqld_main(int, char**)+0x1baf) [0xe308df]
/lib64/libc.so.6(__libc_start_main+0xf5) [0x7f5ffd723555]
/opt/polardbx_engine/bin/mysqld() [0xe16137]
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
2024-03-24T06:38:54.662940Z mysqld_safe Number of processes running now: 0
2024-03-24T06:38:54.667079Z mysqld_safe mysqld restarted
2024-03-24T06:38:54.923202Z 0 [System] [MY-010116] [Server] /opt/polardbx_engine/bin/mysqld (mysqld 8.0.30) starting as process 18979
2024-03-24T06:38:54.923241Z 0 [ERROR] [MY-010338] [Server] Can't find error-message file '/opt/polardbx-engine/share/errmsg.sys'. Check error-message file location and 'lc-messages-dir' configuration directive.

my.cnf

[mysqld]
server-id=2
basedir = /opt/polardbx-engine
log_error_verbosity = 2
default_authentication_plugin = mysql_native_password
gtid_mode = ON
enforce_gtid_consistency = ON
log_bin = mysql-binlog
binlog_format = row
binlog_row_image = FULL
master_info_repository = TABLE
relay_log_info_repository = TABLE

datadir = /home/polarx/polardbx-engine/data
tmpdir = /home/polarx/polardbx-engine/tmp
socket = /home/polarx/polardbx-engine/tmp.mysql.sock
log_error = /home/polarx/polardbx-engine/log/alert.log
port = 4886
cluster_id = 1234
cluster_info = 192.168.110.102:14886;192.168.110.103:14886;192.168.110.104:14886;@1

[mysqld_safe]
pid_file = /home/polarx/polardbx-engine/run/mysql.pid

ARM平台make error

平台：Kylin Linux Advanced Server release V10 (Tercel)
gcc：gcc (GCC) 7.3.0
报错信息：

[ 56%] Building CXX object storage/xengine/CMakeFiles/xengine_se.dir/core/memtable/art.cc.o
In file included from /data/GalaxyDB/galaxyengine/storage/xengine/core/memtable/art.h:17:0,
                 from /data/GalaxyDB/galaxyengine/storage/xengine/core/memtable/art.cc:15:
/data/GalaxyDB/galaxyengine/storage/xengine/core/memtable/art_node.h:28:10: fatal error: x86intrin.h: No such file or directory
 #include <x86intrin.h>
          ^~~~~~~~~~~~~
compilation terminated.
make[2]: *** [storage/xengine/CMakeFiles/xengine_se.dir/build.make:1194: storage/xengine/CMakeFiles/xengine_se.dir/core/memtable/art.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:3836: storage/xengine/CMakeFiles/xengine_se.dir/all] Error 2

查了下，应该是arm平台上gcc里不包含<x86intrin.h>这个头文件（包括下面的<emmintrin.h>,<immintrin.h>），尝试改为clang，报错信息更多

文档？

有编译安装的文档吗？已经docker镜像？

I encountered some questions when compiling project on Ubuntu 20.04

CMake Error at mysys/CMakeLists.txt:179 (ADD_DEPENDENCIES):
  The dependency target "libcrypto" of target "mysys" does not exist.


CMake Error at mysys/CMakeLists.txt:179 (ADD_DEPENDENCIES):
  The dependency target "libssl" of target "mysys" does not exist.


CMake Error at router/src/http/src/CMakeLists.txt:44 (ADD_DEPENDENCIES):
  The dependency target "libcrypto" of target "http_common" does not exist.


CMake Error at router/src/http/src/CMakeLists.txt:44 (ADD_DEPENDENCIES):
  The dependency target "libssl" of target "http_common" does not exist.


-- Generating done
CMake Generate step failed.  Build files cannot be regenerated correctly.

The compiler version is GCC9.4.0， I have installed libssl and libcrypto.

What's the difference between X-Engine and RocksDB?

X-Engine seems derived from RocksDB ? https://github.com/ApsaraDB/galaxyengine/tree/main/storage/xengine/core

What's the difference between X-Engine and RocksDB?

Where can I find the source code of XPaxos?

Would you please offer RPM spec file and image build script for galaxykube？

A crash caused by Assertion `!table || (!table->read_set || bitmap_is_set(table->read_set, field_index))' failed

POC:
create databse test2;
use test2;
CREATE TABLE v0 ( CHECK ( ( + '' ) / CONVERT ( DEFAULT ( v2 ) , REAL ) IS NULL IS NULL IS NULL IS UNKNOWN ) , v3 BINARY COLLATE BINARY AS ( 'x' ) STORED , v2 MEDIUMINT NULL SERIAL DEFAULT VALUE SERIAL DEFAULT VALUE , v1 LONGBLOB ) ;
INSERT DELAYED IGNORE INTO v0 ( ) VALUES ( -1 , 63144147.000000 , 'x' ) ;
SELECT * FROM v0 WHERE v2 IN ( SELECT v3 FROM v0 ) ORDER BY v0 . v3 ;

root@zhiyong-dbms ~/w/P/g/build (main) [1]# ./bin/mysqld --defaults-file=my.cnf --user=root
2021-10-22T01:39:33.275212-00:00 0 [Warning] [MY-010140] [Server] Could not increase number of max_open_files to more than 1024 (request: 615350)
2021-10-22T01:39:33.275229-00:00 0 [Warning] [MY-010141] [Server] Changed limits: max_connections: 214 (requested 36000)
2021-10-22T01:39:33.275244-00:00 0 [Warning] [MY-010142] [Server] Changed limits: table_open_cache: 400 (requested 32768)
2021-10-22T01:39:33.402336-00:00 0 [Warning] [MY-011069] [Server] The syntax '--relay-log-info-file' is deprecated and will be removed in a future release.
2021-10-22T01:39:33.402369-00:00 0 [Warning] [MY-011069] [Server] The syntax '--master-info-file' is deprecated and will be removed in a future release.
2021-10-22T01:39:33.402458-00:00 0 [Warning] [MY-011069] [Server] The syntax '--log-bin-use-v1-row-events' is deprecated and will be removed in a future release.
2021-10-22T01:39:33.402639-00:00 0 [Warning] [MY-011068] [Server] The syntax 'expire-logs-days' is deprecated and will be removed in a future release. Please use binlog_expire_logs_seconds instead.
2021-10-22T01:39:33.402678-00:00 0 [Warning] [MY-011069] [Server] The syntax '--slave-rows-search-algorithms' is deprecated and will be removed in a future release.
2021-10-22T01:39:33.402873-00:00 0 [Warning] [MY-010084] [Server] options --log-slow-admin-statements, --log-queries-not-using-indexes and --log-slow-slave-statements have no effect if --slow-query-log is not set
2021-10-22T01:39:33.402888-00:00 0 [Warning] [MY-010086] [Server] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2021-10-22T01:39:33.403035-00:00 0 [System] [MY-010116] [Server] /root/workspace/PolarDB/galaxyengine/build/bin/mysqld (mysqld 8.0.18-debug-asan) starting as process 62434
2021-10-22T01:39:33.405560-00:00 0 [Warning] [MY-013242] [Server] --character-set-server: 'utf8' is currently an alias for the character set UTF8MB3, but will be an alias for UTF8MB4 in a future release. Please consider using UTF8MB4 in order to be unambiguous.
2021-10-22T01:39:33.406470-00:00 0 [Warning] [MY-010108] [Server] setrlimit could not change the size of core files to 'infinity'; We may not be able to generate a core file on signals
2021-10-22T01:39:33.423468-00:00 0 [Warning] [MY-012364] [InnoDB] innodb_open_files should not be greater than the open_files_limit.

2021-10-22T01:39:40.456316-00:00 0 [System] [MY-010229] [Server] Starting crash recovery...
2021-10-22T01:39:40.469962-00:00 0 [System] [MY-010232] [Server] Crash recovery finished.
2021-10-22T01:39:40.708335-00:00 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2021-10-22T01:39:40.765125-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_polarx_port=32886'.
2021-10-22T01:39:40.766398-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_polarx_max_connections=5000'.
2021-10-22T01:39:40.767610-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-info=127.0.0.1:14886@1'.
2021-10-22T01:39:40.768802-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-id=5431'.
2021-10-22T01:39:40.769966-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_enable_gts=1'.
2021-10-22T01:39:40.771134-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_sql_info=1'.
2021-10-22T01:39:40.772369-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_sql_info_index=1'.
2021-10-22T01:39:40.773577-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_indexstat=1'.
2021-10-22T01:39:40.774776-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_tablestat=1'.
2021-10-22T01:39:40.776004-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_slave_pr_mode=TABLE'.
2021-10-22T01:39:40.777239-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_large_trx=ON'.
2021-10-22T01:39:40.778468-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus-io-thread_cnt=8'.
2021-10-22T01:39:40.779707-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus-worker-thread_cnt=8'.
2021-10-22T01:39:40.780999-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_max_delay_index=10000'.
2021-10-22T01:39:40.782251-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus-election-timeout=10000'.
2021-10-22T01:39:40.783519-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_max_packet_size=131072'.
2021-10-22T01:39:40.784800-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_max_log_size=20M'.
2021-10-22T01:39:40.786067-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_auto_leader_transfer=ON'.
2021-10-22T01:39:40.787349-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_log_cache_size=536870912'.
2021-10-22T01:39:40.788652-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_prefetch_cache_size=268435456'.
2021-10-22T01:39:40.789952-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_prefetch_window_size=100'.
2021-10-22T01:39:40.791255-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_auto_reset_match_index=ON'.
2021-10-22T01:39:40.792581-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-mts-recover-use-index=ON'.
2021-10-22T01:39:40.793905-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_async_commit_thread_count=128'.
2021-10-22T01:39:40.795241-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_commit_lock_done_count=1'.
2021-10-22T01:39:40.796568-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-log-type-node=OFF'.
2021-10-22T01:39:40.797917-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_slow_verbosity=full'.
2021-10-22T01:39:40.799270-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_rds_check_core_file_enabled=ON'.
2021-10-22T01:39:40.800650-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_boost_pk_access=1'.
2021-10-22T01:39:40.802019-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_io_state=1'.
2021-10-22T01:39:40.803405-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_use_myfs=0'.
2021-10-22T01:39:40.804773-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_daemon_memcached_values_delimiter=:;:'.
2021-10-22T01:39:40.806172-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_daemon_memcached_option=-t 32 -c 8000 -p15506'.
2021-10-22T01:39:41.106212-00:00 0 [System] [MY-010931] [Server] /root/workspace/PolarDB/galaxyengine/build/bin/mysqld: ready for connections. Version: '8.0.18-debug-asan' socket: '/root/workspace/PolarDB/galaxyengine/build/run/mysql.sock' port: 4886 Source distribution.
2021-10-22T01:39:41.312444-00:00 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 32886 socket: '/tmp/mysqlx.sock' bind-address: '::' port: 33060
mysqld: sql/field.cc:3618: virtual double Field_medium::val_real() const: Assertion `!table || (!table->read_set || bitmap_is_set(table->read_set, field_index))' failed.
01:42:56 UTC - mysqld got signal 6 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.
Thread pointer: 0x62700042f100
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7fd3cb6dcbd0 thread_stack 0x100000
/usr/lib/x86_64-linux-gnu/libasan.so.4(+0x566d0) [0x7fd4193606d0]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0xa9) [0x55f92b92a06d]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(handle_fatal_signal+0x523) [0x55f929e3c20e]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7fd4192fc3c0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb) [0x7fd41894b18b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b) [0x7fd41892a859]
/lib/x86_64-linux-gnu/libc.so.6(+0x25729) [0x7fd41892a729]
/lib/x86_64-linux-gnu/libc.so.6(+0x36f36) [0x7fd41893bf36]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Field_medium::val_real() const+0x112) [0x55f928fbc5f0]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_field::val_real()+0xf2) [0x55f929016104]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_typecast_real::val_real()+0x7f) [0x55f9290c7a61]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_div::real_op()+0x121) [0x55f9290d4421]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_numhybrid::val_real()+0x4ce) [0x55f9290c322e]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item::evaluate(THD*, String*)+0x440) [0x55f929028ff4]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item::update_null_value()+0x100) [0x55f9290291fa]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_numhybrid::is_null()+0x11) [0x55f9291035e1]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_isnull::update_used_tables()+0x21f) [0x55f9292cdbd1]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_isnull::resolve_type(THD*)+0xcc) [0x55f9292d4dea]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_fields(THD*, Item**)+0x2f4) [0x55f9290d2b72]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_isnull::fix_fields(THD*, Item**)+0xc2) [0x55f9292e0fb8]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_func_arg(THD*, Item**)+0x26d) [0x55f9290d2725]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_fields(THD*, Item**)+0x325) [0x55f9290d2ba3]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_isnull::fix_fields(THD*, Item**)+0xc2) [0x55f9292e0fb8]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_func_arg(THD*, Item**)+0x26d) [0x55f9290d2725]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_fields(THD*, Item**)+0x325) [0x55f9290d2ba3]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_isnull::fix_fields(THD*, Item**)+0xc2) [0x55f9292e0fb8]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_func_arg(THD*, Item**)+0x26d) [0x55f9290d2725]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func::fix_fields(THD*, Item**)+0x325) [0x55f9290d2ba3]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Item_func_isnull::fix_fields(THD*, Item**)+0xc2) [0x55f9292e0fb8]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0x7d96744) [0x55f929ca6744]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(unpack_value_generator(THD*, TABLE*, Value_generator**, Value_generator_source, char const*, Field*, bool, bool*)+0x8d0) [0x55f929cb1a4b]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(open_table_from_share(THD*, TABLE_SHARE*, char const*, unsigned int, unsigned int, unsigned int, TABLE*, bool, dd::Table const*)+0x2485) [0x55f929cb448f]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(ha_create_table(THD*, char const*, char const*, char const*, HA_CREATE_INFO*, bool, bool, dd::Table*, bool, HA_CREATE_INFO*)+0x305) [0x55f929164e42]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0x7c6df6d) [0x55f929b7df6d]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0x7c9b060) [0x55f929bab060]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_create_table_no_lock(THD*, char const*, char const*, HA_CREATE_INFO*, Alter_info*, unsigned int, bool, bool*, handlerton**)+0xec3) [0x55f929bac2e2]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_create_table(THD*, TABLE_LIST*, HA_CREATE_INFO*, Alter_info*)+0xb4a) [0x55f929bbdc24]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Sql_cmd_create_table::execute(THD*)+0x116b) [0x55f92988992b]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_execute_command(THD*, bool)+0x3820) [0x55f929a2a598]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_parse(THD*, Parser_state*)+0xa0c) [0x55f929a31d71]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(dispatch_command(THD*, COM_DATA const*, enum_server_command)+0x1f61) [0x55f929a3469f]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(do_command(THD*)+0xaa6) [0x55f929a37e0f]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0x7ef4819) [0x55f929e04819]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0xa63f4c4) [0x55f92c54f4c4]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609) [0x7fd4192f0609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43) [0x7fd418a27293]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (61200020e568): CREATE TABLE v0 ( CHECK ( ( + '' ) / CONVERT ( DEFAULT ( v2 ) , REAL ) IS NULL IS NULL IS NULL IS UNKNOWN ) , v3 BINARY COLLATE BINARY AS ( 'x' ) STORED , v2 MEDIUMINT NULL SERIAL DEFAULT VALUE SERIAL DEFAULT VALUE , v1 LONGBLOB )
Connection ID (thread ID): 9
Status: NOT_KILLED

The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
Writing a core file
fish: './bin/mysqld --defaults-file=my…' terminated by signal SIGABRT (Abort)

make -j8 failed

OS: Ubuntu 20.04 LTS (GNU/Linux 5.4.0-42-generic x86_64)

[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xprotocol_impl.cc.o
In file included from /home/ubuntu/develop/galaxyengine/sql/sql_cmd.h:31:0,
                 from /home/ubuntu/develop/galaxyengine/sql/sql_plugin.h:34,
                 from /home/ubuntu/develop/galaxyengine/include/mysql/plugin.h:35,
                 from /home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:29:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘bool ha_sequence::setup_base_engine()’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:623:15: error: ‘FALSE’ was not declared in this scope
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:623:15: note: suggested alternative: ‘FILE’
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:626:15: error: ‘TRUE’ was not declared in this scope
   DBUG_RETURN(TRUE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘bool ha_sequence::setup_base_handler(MEM_ROOT*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:662:17: error: ‘TRUE’ was not declared in this scope
     DBUG_RETURN(TRUE);
                 ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:664:15: error: ‘FALSE’ was not declared in this scope
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:664:15: note: suggested alternative: ‘FILE’
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘bool ha_sequence::get_from_handler_file(const char*, MEM_ROOT*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:678:27: error: ‘FALSE’ was not declared in this scope
   if (m_file) DBUG_RETURN(FALSE);
                           ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:678:27: note: suggested alternative: ‘FILE’
   if (m_file) DBUG_RETURN(FALSE);
                           ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:682:15: error: ‘FALSE’ was not declared in this scope
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:682:15: note: suggested alternative: ‘FILE’
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:685:15: error: ‘TRUE’ was not declared in this scope
   DBUG_RETURN(TRUE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘bool ha_sequence::new_handler_from_sequence_info(MEM_ROOT*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:704:17: error: ‘TRUE’ was not declared in this scope
     DBUG_RETURN(TRUE);
                 ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:706:15: error: ‘FALSE’ was not declared in this scope
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:706:15: note: suggested alternative: ‘FILE’
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘bool ha_sequence::initialize_sequence(MEM_ROOT*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:722:19: error: ‘TRUE’ was not declared in this scope
       DBUG_RETURN(TRUE);
                   ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:725:17: error: ‘TRUE’ was not declared in this scope
     DBUG_RETURN(TRUE);
                 ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:730:17: error: ‘TRUE’ was not declared in this scope
     DBUG_RETURN(TRUE);
                 ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:172:7: note: in definition of macro ‘DBUG_EXECUTE_IF’
       a1                                 \
       ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:730:5: note: in expansion of macro ‘DBUG_RETURN’
     DBUG_RETURN(TRUE);
     ^
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:733:15: error: ‘FALSE’ was not declared in this scope
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:733:15: note: suggested alternative: ‘FILE’
   DBUG_RETURN(FALSE);
               ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘virtual int ha_sequence::create(const char*, TABLE*, HA_CREATE_INFO*, dd::Table*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:1154:68: error: ‘TRUE’ was not declared in this scope
   if (get_from_handler_file(name, ha_thd()->mem_root)) DBUG_RETURN(TRUE);
                                                                    ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘virtual int ha_sequence::delete_table(const char*, const dd::Table*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:1193:68: error: ‘TRUE’ was not declared in this scope
   if (get_from_handler_file(name, ha_thd()->mem_root)) DBUG_RETURN(TRUE);
                                                                    ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc: In member function ‘virtual int ha_sequence::rename_table(const char*, const char*, const dd::Table*, dd::Table*)’:
/home/ubuntu/develop/galaxyengine/sql/ha_sequence.cc:1307:68: error: ‘TRUE’ was not declared in this scope
   if (get_from_handler_file(from, ha_thd()->mem_root)) DBUG_RETURN(TRUE);
                                                                    ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xrow_impl.cc.o
make[2]: *** [sql/CMakeFiles/sequence.dir/build.make:63: sql/CMakeFiles/sequence.dir/ha_sequence.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:10502: sql/CMakeFiles/sequence.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xquery_result_impl.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient.dir/xcompression_impl.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xsession_impl.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient.dir/xrow.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient.dir/validator/capability_compression_validator.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient.dir/galaxy_protocol_string.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient.dir/__/__/__/sql-common/net_ns.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xconnection_impl.cc.o
[ 61%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xcompression_negotiator.cc.o
[ 62%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xcompression_impl.cc.o
[ 62%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/xrow.cc.o
[ 62%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/validator/capability_compression_validator.cc.o
[ 62%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/galaxy_protocol_string.cc.o
[ 62%] Building CXX object plugin/x/client/CMakeFiles/mysqlxclient_lite.dir/__/__/__/sql-common/net_ns.cc.o
[ 62%] Linking CXX static library libmysqlxclient.a
[ 62%] Built target mysqlxclient
[ 62%] Linking CXX static library libmysqlxclient_lite.a
[ 62%] Built target mysqlxclient_lite
make: *** [Makefile:163: all] Error 2

请问下标准版的版本兼容性

你好, 安装标准版之后执行show VARIABLES like 'version'; 看到版本是8.0.30, 然后在配置文件增加innodb_ddl_threads和innodb_ddl_buffer_size这两个参数就无法启动了, 看报错是不支持这两个参数, 但是这两个参数是8.0.27社区版本的, 按道理8.0.30版应该是包括了8.0.27版本的, 请问下这个要怎么处理呢

无法启动

2022-12-05T10:16:26.180670Z 0 [Warning] [MY-011069] [Server] The syntax '--relay-log-info-file' is deprecated and will be removed in a future release.
2022-12-05T10:16:26.180702Z 0 [Warning] [MY-011069] [Server] The syntax '--master-info-file' is deprecated and will be removed in a future release.
2022-12-05T10:16:26.180959Z 0 [Warning] [MY-010084] [Server] options --log-slow-admin-statements, --log-queries-not-using-indexes and --log-slow-slave-statements have no effect if --slow-query-log is not set
2022-12-05T10:16:26.181201Z 0 [System] [MY-013169] [Server] /usr/local/mysql/bin/mysqld (mysqld 8.0.30-debug) initializing of server in progress as process 5603
2022-12-05T10:16:35.675161Z 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_slow_verbosity=full'.

Is it necessary to configure large write buffers for good performance of X-Engine?

Hi galaxyengine developers,

I found some large configurations for write buffers of X-Engine in:

storage/xengine/core/pt_beilou.sh
storage/xengine/tools/sysbench_benchmark/rds_my.cnf

Like:

xengine_write_buffer_size=512M
xengine_max_write_buffer_number=1000
xengine_max_write_buffer_number_to_maintain=1000
xengine_db_write_buffer_size=100G
xengine_db_total_write_buffer_size=100G

These options make much memory be used in memtables, which seems pretty more than that in RocskDB's benchmark.

It is said that larger memtables result in longer recovery time. And the write throughput is finally decided by compaction.

Could you tell us more about your considerations on these buffer configurations? Is it necessary to configure large write buffers for good performance of X-Engine?

Thanks.

dn节点的engine容器起不来，卡死在running状态

galaxyengine version: latest
现象:
dn三个节点cand1,cand2,log0的engine的container无法正常启动，其中cand1的alert.log有如下错误：
[2022-08-05 14:24:11.830049] [ERROR] EasyNet::onConnected server 1
[2022-08-05 14:24:11.830573] [ERROR] EasyNet::onConnected server 2
[2022-08-05 14:24:13.903579] [ERROR] Server 3 : new term(old:30,new:32) !!
[2022-08-05 14:24:13.903579] [ERROR] Server 3 : Paxos state change from FOLL to FOLL !!
[2022-08-05 14:24:19.904576] [ERROR] Server 3 : leaderStickiness check: msg::force(1) state_:0 electionTimer_::Stage:0 leaderId_:2 .
[2022-08-05 14:24:19.904576] [ERROR] Server 3 : New Term in onRequestVote !! server 1 's term(33) is bigger than me(32).
[2022-08-05 14:24:19.904576] [ERROR] Server 3 : new term(old:32,new:33) !!
[2022-08-05 14:24:19.904576] [ERROR] Server 3 : Paxos state change from FOLL to FOLL !!
[2022-08-05 14:24:19.904576] [ERROR] Server 3 : isVote: 1, local(lli:2563665, llt:32); msg(candidateid: 1, term: 33 lli:2563665, llt:32) .
2022-08-05T14:24:23.724310+08:00 5 [Warning] [MY-000000] [Server] Apply thread start, recover status = 0, start apply index = 0, rli consensus index = 733096.
2022-08-05T14:24:23.738472+08:00 0 [System] [MY-010931] [Server] /opt/galaxy_engine/bin/mysqld: ready for connections. Version: '8.0.18' socket: '/data/mysql/run/mysql.sock' port: 17822 Source distribution.
2022-08-05T14:24:23.857115+08:00 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 45822 socket: '/tmp/mysqlx.sock' bind-address: '::' port: 33060
2022-08-05T14:24:25.010332+08:00 5 [Warning] [MY-000000] [Server] Apply thread group relay log file name = '/data/mysql/log/mysql_bin.000003', pos = 323488886, rli apply index = 733096.
2022-08-05T14:24:25.089284+08:00 5 [ERROR] [MY-010584] [Repl] Slave SQL for channel '': Error 'XAER_NOTA: Unknown XID' on query. Default database: '__cdc___single'. Query: 'XA COMMIT X'647264732d313462343830623166613430313030304062623236613963383163636433386265',X'5f5f4344435f5f5f53494e474c455f47524f5550',1', Error_code: MY-001397
2022-08-05T14:24:25.089370+08:00 5 [Warning] [MY-010584] [Repl] Slave: XAER_NOTA: Unknown XID Error_code: MY-001397
2022-08-05T14:24:25.092896+08:00 5 [ERROR] [MY-010586] [Repl] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'FIRST' position 323488886

把三个节点的数据目录都删除并删除对应的pod，触发重建，dn节点便能正常启动，但是此时因为数据被清空，会导致跟gms关联的信息不一致，猜测是异常停节点时导致数据损坏了，这个情况下，应该如何恢复集群？
如果登陆到cand1的engine，show slave status\G，会有Error 'XAER_NOTA: Unknown XID' on query. Default database: '__cdc___single'. Query: 'XA COMMIT X'647264732d313462343830623166613430313030304062623236613963383163636433386265',X'5f5f4344435f5f5f53494e474c455f47524f5550',1'的错误，因为跟传统mysql不一样，有没有相关文档供参考

compiling failed according to development doc

Complile GalaxyEngine according to https://github.com/ApsaraDB/galaxysql/blob/main/docs/en/quickstart-development.md. got some errors when running cmake and make.
cmake .
-DFORCE_INSOURCE_BUILD=ON
-DWITH_DEBUG=ON
-DSYSCONFDIR="/u01/mysql"
-DCMAKE_INSTALL_PREFIX="/u01/mysql"
-DMYSQL_DATADIR="/u01/mysql/data"
-DWITH_XENGINE_STORAGE_ENGINE=OFF
-DWITH_BOOST="./extra/boost/boost_1_70_0.tar.gz"

PolarDB-X为什么还需要GSO（全局的事务号）？

涉及多节点的查询，不是可以直接用全局时间戳进行比较了么？

Would XPaxos be open source?

Would XPaxos be open source on github later?

Cache-Conscious Block Layout 如何实现？

请教下，这篇文章中 (https://developer.aliyun.com/article/750668) 提到的 "Cache-Conscious Block Layout" 实现，是否有更详尽的解释呢？或者在哪个代码文件中有实现？

A signal crash caused by assertion failure

PoC：
create database test；
use test；
CREATE TABLE v0 ( v1 TIMESTAMP , NONE YEAR ZEROFILL COMMENT 'x' ) ;
CREATE TRIGGER v0 BEFORE INSERT ON v0 FOR EACH ROW DROP TABLESPACE MASTER_PASSWORD WAIT ;
INSERT INTO v0 VALUES ( 127 , 'x' SOUNDS LIKE v1 IS TRUE ) , ( NULL , NULL ) ;

Log:
2021-10-22T01:19:36.289847-00:00 0 [Warning] [MY-010140] [Server] Could not increase number of max_open_files to more than 1024 (request: 615350)
2021-10-22T01:19:36.289862-00:00 0 [Warning] [MY-010141] [Server] Changed limits: max_connections: 214 (requested 36000)
2021-10-22T01:19:36.289880-00:00 0 [Warning] [MY-010142] [Server] Changed limits: table_open_cache: 400 (requested 32768)
2021-10-22T01:19:36.410489-00:00 0 [Warning] [MY-011069] [Server] The syntax '--relay-log-info-file' is deprecated and will be removed in a future release.
2021-10-22T01:19:36.410524-00:00 0 [Warning] [MY-011069] [Server] The syntax '--master-info-file' is deprecated and will be removed in a future release.
2021-10-22T01:19:36.410622-00:00 0 [Warning] [MY-011069] [Server] The syntax '--log-bin-use-v1-row-events' is deprecated and will be removed in a future release.
2021-10-22T01:19:36.410803-00:00 0 [Warning] [MY-011068] [Server] The syntax 'expire-logs-days' is deprecated and will be removed in a future release. Please use binlog_expire_logs_seconds instead.
2021-10-22T01:19:36.410845-00:00 0 [Warning] [MY-011069] [Server] The syntax '--slave-rows-search-algorithms' is deprecated and will be removed in a future release.
2021-10-22T01:19:36.411057-00:00 0 [Warning] [MY-010084] [Server] options --log-slow-admin-statements, --log-queries-not-using-indexes and --log-slow-slave-statements have no effect if --slow-query-log is not set
2021-10-22T01:19:36.411072-00:00 0 [Warning] [MY-010086] [Server] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2021-10-22T01:19:36.411227-00:00 0 [System] [MY-010116] [Server] /root/workspace/PolarDB/galaxyengine/build/bin/mysqld (mysqld 8.0.18-debug-asan) starting as process 61191
2021-10-22T01:19:36.413769-00:00 0 [Warning] [MY-013242] [Server] --character-set-server: 'utf8' is currently an alias for the character set UTF8MB3, but will be an alias for UTF8MB4 in a future release. Please consider using UTF8MB4 in order to be unambiguous.
2021-10-22T01:19:36.414683-00:00 0 [Warning] [MY-010108] [Server] setrlimit could not change the size of core files to 'infinity'; We may not be able to generate a core file on signals
2021-10-22T01:19:36.551597-00:00 0 [Warning] [MY-012364] [InnoDB] innodb_open_files should not be greater than the open_files_limit.

2021-10-22T01:19:44.507074-00:00 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2021-10-22T01:19:44.612162-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_polarx_port=32886'.
2021-10-22T01:19:44.613246-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_polarx_max_connections=5000'.
2021-10-22T01:19:44.614205-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-info=127.0.0.1:14886@1'.
2021-10-22T01:19:44.615177-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-id=5431'.
2021-10-22T01:19:44.616156-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_enable_gts=1'.
2021-10-22T01:19:44.617143-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_sql_info=1'.
2021-10-22T01:19:44.618121-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_sql_info_index=1'.
2021-10-22T01:19:44.619103-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_indexstat=1'.
2021-10-22T01:19:44.620110-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_tablestat=1'.
2021-10-22T01:19:44.621126-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_slave_pr_mode=TABLE'.
2021-10-22T01:19:44.622147-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_large_trx=ON'.
2021-10-22T01:19:44.623175-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus-io-thread_cnt=8'.
2021-10-22T01:19:44.624217-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus-worker-thread_cnt=8'.
2021-10-22T01:19:44.625256-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_max_delay_index=10000'.
2021-10-22T01:19:44.626288-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus-election-timeout=10000'.
2021-10-22T01:19:44.627350-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_max_packet_size=131072'.
2021-10-22T01:19:44.628391-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_max_log_size=20M'.
2021-10-22T01:19:44.629446-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_auto_leader_transfer=ON'.
2021-10-22T01:19:44.630512-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_log_cache_size=536870912'.
2021-10-22T01:19:44.631583-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_prefetch_cache_size=268435456'.
2021-10-22T01:19:44.632664-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_prefetch_window_size=100'.
2021-10-22T01:19:44.633729-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_consensus_auto_reset_match_index=ON'.
2021-10-22T01:19:44.634822-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-mts-recover-use-index=ON'.
2021-10-22T01:19:44.635915-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_async_commit_thread_count=128'.
2021-10-22T01:19:44.637022-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_commit_lock_done_count=1'.
2021-10-22T01:19:44.638140-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_cluster-log-type-node=OFF'.
2021-10-22T01:19:44.639272-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_log_slow_verbosity=full'.
2021-10-22T01:19:44.640411-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_rds_check_core_file_enabled=ON'.
2021-10-22T01:19:44.641540-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_boost_pk_access=1'.
2021-10-22T01:19:44.642692-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_io_state=1'.
2021-10-22T01:19:44.643842-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_use_myfs=0'.
2021-10-22T01:19:44.645026-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_daemon_memcached_values_delimiter=:;:'.
2021-10-22T01:19:44.646197-00:00 0 [Warning] [MY-000067] [Server] unknown variable 'loose_daemon_memcached_option=-t 32 -c 8000 -p15506'.
2021-10-22T01:19:45.101253-00:00 0 [System] [MY-010931] [Server] /root/workspace/PolarDB/galaxyengine/build/bin/mysqld: ready for connections. Version: '8.0.18-debug-asan' socket: '/root/workspace/PolarDB/galaxyengine/build/run/mysql.sock' port: 4886 Source distribution.
2021-10-22T01:19:45.369035-00:00 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 32886 socket: '/tmp/mysqlx.sock' bind-address: '::' port: 33060
mysqld: sql/sql_parse.cc:3034: int mysql_execute_command(THD*, bool): Assertion `!thd->in_sub_stmt' failed.
01:35:07 UTC - mysqld got signal 6 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.
Thread pointer: 0x627000380100
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7fc98f5abbd0 thread_stack 0x100000
/usr/lib/x86_64-linux-gnu/libasan.so.4(+0x566d0) [0x7fc9dbe7b6d0]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0xa9) [0x559f563f106d]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(handle_fatal_signal+0x523) [0x559f5490320e]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7fc9dbe173c0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb) [0x7fc9db46618b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b) [0x7fc9db445859]
/lib/x86_64-linux-gnu/libc.so.6(+0x25729) [0x7fc9db445729]
/lib/x86_64-linux-gnu/libc.so.6(+0x36f36) [0x7fc9db456f36]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_execute_command(THD*, bool)+0x1348) [0x559f544ef0c0]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(sp_instr_stmt::exec_core(THD*, unsigned int*)+0xe4) [0x559f541f1f6a]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(sp_lex_instr::reset_lex_and_exec_core(THD*, unsigned int*, bool)+0x303) [0x559f541f5d23]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(sp_lex_instr::validate_lex_and_execute_core(THD*, unsigned int*, bool)+0x28b) [0x559f541f6a3d]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(sp_instr_stmt::execute(THD*, unsigned int*)+0x30b) [0x559f541f7ed5]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(sp_head::execute(THD*, bool)+0xe14) [0x559f541e0462]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(sp_head::execute_trigger(THD*, MYSQL_LEX_CSTRING const&, MYSQL_LEX_CSTRING const&, GRANT_INFO*)+0x7f6) [0x559f541e1a32]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Trigger::execute(THD*)+0x1ea) [0x559f5479f3e2]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Trigger_chain::execute_triggers(THD*)+0xb3) [0x559f547a2ead]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Table_trigger_dispatcher::process_triggers(THD*, enum_trigger_event_type, enum_trigger_action_time_type, bool)+0x15c) [0x559f5479062a]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(call_before_insert_triggers(THD*, TABLE*, enum_trigger_event_type, MY_BITMAP*)+0x87) [0x559f5428f59d]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(fill_record_n_invoke_before_triggers(THD*, Field**, List&, TABLE*, enum_trigger_event_type, int)+0x39c) [0x559f5426a2e2]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Sql_cmd_insert_values::execute_inner(THD*)+0xfa6) [0x559f5443f37c]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(Sql_cmd_dml::execute(THD*)+0x74d) [0x559f545d1d15]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_execute_command(THD*, bool)+0x3820) [0x559f544f1598]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(mysql_parse(THD*, Parser_state*)+0xa0c) [0x559f544f8d71]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(dispatch_command(THD*, COM_DATA const*, enum_server_command)+0x1f61) [0x559f544fb69f]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(do_command(THD*)+0xaa6) [0x559f544fee0f]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0x7ef4819) [0x559f548cb819]
/root/workspace/PolarDB/galaxyengine/build/bin/mysqld(+0xa63f4c4) [0x559f570164c4]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x9609) [0x7fc9dbe0b609]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x43) [0x7fc9db542293]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (6070016f0e18): DROP TABLESPACE MASTER_PASSWORD WAIT
Connection ID (thread ID): 9
Status: NOT_KILLED

Why use a fixed length extent to manage disk space？

Hi galaxyengine developers, I have some confusion about extent.
Why use a fixed length extent to manage disk space instead of directly using a single file like Rocksdb?
Using a 2MB fixed length extent can cause space waste.
If extent reuse is required, using a single file can also achieve this.

[seek help]failed in compiation on intel x86_64 + openSUSE Leap 42.3

I met many errors in cmaking, The most obvious ones are that gcc cannot recognise LLVM related linker and miss some headers. Can anyone do me a favor? Thanks in advance.

cmake .                               	\
    -DFORCE_INSOURCE_BUILD=ON           \
    -DCMAKE_BUILD_TYPE="Debug"          \
    -DSYSCONFDIR="/u01/mysql"           \
    -DCMAKE_INSTALL_PREFIX="/u01/mysql" \
    -DMYSQL_DATADIR="/u01/mysql/data"   \
    -DWITH_BOOST="./extra/boost/boost_1_70_0.tar.gz"

CMake logs

CMakeOutput.log
CMakeError.log

environment info

gcc_g++_status.txt
os-release.txt
rpm_installed.txt
tree_headers.txt
zypper_installed_only.txt
zypper_list_repo.txt

compile error of No rule to make target `extra/IS/consensus/bu/libaliconsensus.a

make[2]: *** No rule to make target extra/IS/consensus/bu/libaliconsensus.a', needed by runtime_output_directory/mysqld'. Stop.
make[1]: *** [sql/CMakeFiles/mysqld.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
make[2]: *** No rule to make target extra/IS/consensus/bu/libaliconsensus.a', needed by runtime_output_directory/pfs_connect_attr-t'. Stop.
make[1]: *** [storage/perfschema/unittest/CMakeFiles/pfs_connect_attr-t.dir/all] Error 2

xengine core dump with simple put

the simple code like this would coredump:

// Copyright (c) 2011-present, Facebook, Inc.  All rights reserved.
//  This source code is licensed under both the GPLv2 (found in the
//  COPYING file in the root directory) and Apache 2.0 License
//  (found in the LICENSE.Apache file in the root directory).

#include <cstdio>
#include <string>
// #include <gflags/gflags.h>
#include "xengine/db.h"
#include "xengine/statistics.h"

#include "cache/lru_cache.h"
#include "db/column_family.h"
#include "db/internal_stats.h"
#include "xengine/slice.h"
#include "xengine/options.h"
#include "xengine/table.h"
#include <iostream>
using namespace std;
using namespace xengine;
using namespace xengine::db;
using namespace xengine::common;
using namespace xengine::cache;
using namespace xengine::table;

std::string kDBPath = "/tmp/rocksdb_simple_example";


int main(int argc, char* argv[]) {


  xengine::db::DB* db;
  common::Options options;
  table::BlockBasedTableOptions table_options;
  table_options.filter_policy.reset(NewBloomFilterPolicy(10, true));  
  table_options.cache_index_and_filter_blocks =true;  

  options.table_factory.reset(
      xengine::table::NewExtentBasedTableFactory(table_options));  
  options.create_if_missing = true;

  // open DB
  Status s = DB::Open(options, kDBPath, &db);
  assert(s.ok());
  WriteOptions wop;
  wop.disableWAL = true;
  for(int i=0;i<100;i++){
    // Put key-value
    string value;
    value.assign(1024*1024,'a');
    s = db->Put(wop, "key11" + std::to_string(i), value);
    if(!s.ok()){
      cout <<"put not ok:"<< s.ToString()<<endl;      
    }
  }

  cout <<"-----------------------begin flush-------------------------------"<<endl;  
  s = db->Flush(FlushOptions(),db->DefaultColumnFamily());
  if(!s.ok()){
      cout <<"put not ok:"<< s.ToString()<<endl;      
  }


  delete db;

  return 0;
}



(gdb) 
#0  0x00007fafa9377428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007fafa937902a in __GI_abort () at abort.c:89
#2  0x00007fafa93b97ea in __libc_message (do_abort=do_abort@entry=2, fmt=fmt@entry=0x7fafa94d2ed8 "*** Error in `%s': %s: 0x%s ***\n") at ../sysdeps/posix/libc_fatal.c:175
#3  0x00007fafa93c237a in malloc_printerr (ar_ptr=<optimized out>, ptr=<optimized out>, str=0x7fafa94d2fe8 "double free or corruption (out)", action=3) at malloc.c:5006
#4  _int_free (av=<optimized out>, p=<optimized out>, have_lock=0) at malloc.c:3867
#5  0x00007fafa93c653c in __GI___libc_free (mem=<optimized out>) at malloc.c:2968
#6  0x00000000004c26fe in main (argc=1, argv=0x7ffd3122c3b8) at simple_example.cc:64
(gdb)

Working on ·Ubuntu 16.04.4 LTS ,by using cmd: g++ -ggdb --std=c++11 simple_example.cc -I/root/tmp/galaxyengine/storage/xengine/core/build/include -I../ -DROCKSDB_PLATFORM_POSIX ../libxengine.a -lpthread -laio 。

and the options is:

[2021-12-23 06:58:47.379836] INFO  [25571] [XENGINE] DumpDBFileSummary(db_info_dumper.cc:129) Write Ahead Log file in /tmp/rocksdb_simple_example: 
[2021-12-23 06:58:47.379843] INFO  [25571] [XENGINE] Dump(db_options.cc:109)                         Options.error_if_exists: 0
[2021-12-23 06:58:47.379849] INFO  [25571] [XENGINE] Dump(db_options.cc:111)                       Options.create_if_missing: 1
[2021-12-23 06:58:47.379854] INFO  [25571] [XENGINE] Dump(db_options.cc:113)                         Options.paranoid_checks: 1
[2021-12-23 06:58:47.379860] INFO  [25571] [XENGINE] Dump(db_options.cc:115)                                     Options.env: 0xa71be0
[2021-12-23 06:58:47.379865] INFO  [25571] [XENGINE] Dump(db_options.cc:117)                          Options.max_open_files: -1
[2021-12-23 06:58:47.379870] INFO  [25571] [XENGINE] Dump(db_options.cc:119)                Options.max_file_opening_threads: 16
[2021-12-23 06:58:47.379876] INFO  [25571] [XENGINE] Dump(db_options.cc:121)                               Options.use_fsync: 0
[2021-12-23 06:58:47.379881] INFO  [25571] [XENGINE] Dump(db_options.cc:124)                       Options.max_log_file_size: 0
[2021-12-23 06:58:47.379887] INFO  [25571] [XENGINE] Dump(db_options.cc:127)                  Options.max_manifest_file_size: 18446744073709551615
[2021-12-23 06:58:47.379892] INFO  [25571] [XENGINE] Dump(db_options.cc:130)                   Options.log_file_time_to_roll: 0
[2021-12-23 06:58:47.379897] INFO  [25571] [XENGINE] Dump(db_options.cc:133)                       Options.keep_log_file_num: 1000
[2021-12-23 06:58:47.379903] INFO  [25571] [XENGINE] Dump(db_options.cc:136)                    Options.recycle_log_file_num: 0
[2021-12-23 06:58:47.379908] INFO  [25571] [XENGINE] Dump(db_options.cc:138)                         Options.allow_fallocate: 1
[2021-12-23 06:58:47.379914] INFO  [25571] [XENGINE] Dump(db_options.cc:140)                        Options.allow_mmap_reads: 0
[2021-12-23 06:58:47.379919] INFO  [25571] [XENGINE] Dump(db_options.cc:142)                       Options.allow_mmap_writes: 0
[2021-12-23 06:58:47.379924] INFO  [25571] [XENGINE] Dump(db_options.cc:144)                        Options.use_direct_reads: 0
[2021-12-23 06:58:47.379930] INFO  [25571] [XENGINE] Dump(db_options.cc:148)                        Options.use_direct_io_for_flush_and_compaction: 0
[2021-12-23 06:58:47.379936] INFO  [25571] [XENGINE] Dump(db_options.cc:150)          Options.create_missing_column_families: 0
[2021-12-23 06:58:47.379941] INFO  [25571] [XENGINE] Dump(db_options.cc:152)                              Options.db_log_dir: 
[2021-12-23 06:58:47.379947] INFO  [25571] [XENGINE] Dump(db_options.cc:154)                                 Options.wal_dir: /tmp/rocksdb_simple_example
[2021-12-23 06:58:47.379952] INFO  [25571] [XENGINE] Dump(db_options.cc:156)                Options.table_cache_numshardbits: 7
[2021-12-23 06:58:47.379957] INFO  [25571] [XENGINE] Dump(db_options.cc:159)                      Options.max_subcompactions: 1
[2021-12-23 06:58:47.379963] INFO  [25571] [XENGINE] Dump(db_options.cc:161)                  Options.max_background_flushes: 1
[2021-12-23 06:58:47.379968] INFO  [25571] [XENGINE] Dump(db_options.cc:164)                         Options.WAL_ttl_seconds: 0
[2021-12-23 06:58:47.379973] INFO  [25571] [XENGINE] Dump(db_options.cc:167)                       Options.WAL_size_limit_MB: 0
[2021-12-23 06:58:47.379979] INFO  [25571] [XENGINE] Dump(db_options.cc:170)             Options.manifest_preallocation_size: 4194304
[2021-12-23 06:58:47.379984] INFO  [25571] [XENGINE] Dump(db_options.cc:172)                     Options.is_fd_close_on_exec: 1
[2021-12-23 06:58:47.379990] INFO  [25571] [XENGINE] Dump(db_options.cc:174)                   Options.advise_random_on_open: 1
[2021-12-23 06:58:47.379995] INFO  [25571] [XENGINE] Dump(db_options.cc:177)                    Options.db_write_buffer_size: 0
[2021-12-23 06:58:47.380000] INFO  [25571] [XENGINE] Dump(db_options.cc:180)              Options.db_total_write_buffer_size: 0
[2021-12-23 06:58:47.380005] INFO  [25571] [XENGINE] Dump(db_options.cc:182)         Options.access_hint_on_compaction_start: 1
[2021-12-23 06:58:47.380011] INFO  [25571] [XENGINE] Dump(db_options.cc:184)  Options.new_table_reader_for_compaction_inputs: 0
[2021-12-23 06:58:47.380016] INFO  [25571] [XENGINE] Dump(db_options.cc:187)               Options.compaction_readahead_size: 0
[2021-12-23 06:58:47.380022] INFO  [25571] [XENGINE] Dump(db_options.cc:190)           Options.random_access_max_buffer_size: 1048576
[2021-12-23 06:58:47.380027] INFO  [25571] [XENGINE] Dump(db_options.cc:193)           Options.writable_file_max_buffer_size: 1048576
[2021-12-23 06:58:47.380033] INFO  [25571] [XENGINE] Dump(db_options.cc:195)                      Options.use_adaptive_mutex: 0
[2021-12-23 06:58:47.380038] INFO  [25571] [XENGINE] Dump(db_options.cc:197)                            Options.rate_limiter: (nil)
[2021-12-23 06:58:47.380044] INFO  [25571] [XENGINE] Dump(db_options.cc:200)     Options.sst_file_manager.rate_bytes_per_sec: 0
[2021-12-23 06:58:47.380050] INFO  [25571] [XENGINE] Dump(db_options.cc:203)                          Options.bytes_per_sync: 0
[2021-12-23 06:58:47.380056] INFO  [25571] [XENGINE] Dump(db_options.cc:206)                      Options.wal_bytes_per_sync: 0
[2021-12-23 06:58:47.380061] INFO  [25571] [XENGINE] Dump(db_options.cc:208)                       Options.wal_recovery_mode: 1
[2021-12-23 06:58:47.380066] INFO  [25571] [XENGINE] Dump(db_options.cc:210)                       Options.enable_aio_wal_reader: 1
[2021-12-23 06:58:47.380071] INFO  [25571] [XENGINE] Dump(db_options.cc:212)                       Options.parallel_wal_recovery: 1
[2021-12-23 06:58:47.380076] INFO  [25571] [XENGINE] Dump(db_options.cc:214)                       Options.parallel_recovery_thread_num: 0
[2021-12-23 06:58:47.380082] INFO  [25571] [XENGINE] Dump(db_options.cc:216)                  Options.enable_thread_tracking: 0
[2021-12-23 06:58:47.380088] INFO  [25571] [XENGINE] Dump(db_options.cc:218)         Options.allow_concurrent_memtable_write: 1
[2021-12-23 06:58:47.380093] INFO  [25571] [XENGINE] Dump(db_options.cc:220)      Options.enable_write_thread_adaptive_yield: 1
[2021-12-23 06:58:47.380098] INFO  [25571] [XENGINE] Dump(db_options.cc:223)             Options.write_thread_max_yield_usec: 100
[2021-12-23 06:58:47.380104] INFO  [25571] [XENGINE] Dump(db_options.cc:226)            Options.write_thread_slow_yield_usec: 3
[2021-12-23 06:58:47.380110] INFO  [25571] [XENGINE] Dump(db_options.cc:233)                               Options.row_cache: None
[2021-12-23 06:58:47.380115] INFO  [25571] [XENGINE] Dump(db_options.cc:237)                              Options.wal_filter: None
[2021-12-23 06:58:47.380120] INFO  [25571] [XENGINE] Dump(db_options.cc:240)             Options.avoid_flush_during_recovery: 0
[2021-12-23 06:58:47.380126] INFO  [25571] [XENGINE] Dump(db_options.cc:242)                         Options.compaction_type: Stream
[2021-12-23 06:58:47.380131] INFO  [25571] [XENGINE] Dump(db_options.cc:244)                         Options.compaction_mode: 0
[2021-12-23 06:58:47.380137] INFO  [25571] [XENGINE] Dump(db_options.cc:246)               Options.cpu_compaction_thread_num: 8
[2021-12-23 06:58:47.380142] INFO  [25571] [XENGINE] Dump(db_options.cc:248)              Options.fpga_compaction_thread_num: 8
[2021-12-23 06:58:47.380147] INFO  [25571] [XENGINE] Dump(db_options.cc:250)                          Options.fpga_device_id: 0
[2021-12-23 06:58:47.380152] INFO  [25571] [XENGINE] Dump(db_options.cc:252)                        Options.table_cache_size: 1073741824
[2021-12-23 06:58:47.380158] INFO  [25571] [XENGINE] Dump(db_options.cc:326)             Options.base_background_compactions: 1
[2021-12-23 06:58:47.380164] INFO  [25571] [XENGINE] Dump(db_options.cc:328)              Options.max_background_compactions: 1
[2021-12-23 06:58:47.380169] INFO  [25571] [XENGINE] Dump(db_options.cc:330)             Options.avoid_flush_during_shutdown: 0
[2021-12-23 06:58:47.380175] INFO  [25571] [XENGINE] Dump(db_options.cc:333)                      Options.delayed_write_rate: 16777216
[2021-12-23 06:58:47.380181] INFO  [25571] [XENGINE] Dump(db_options.cc:336)                      Options.max_total_wal_size: 0
[2021-12-23 06:58:47.380186] INFO  [25571] [XENGINE] Dump(db_options.cc:339)     Options.delete_obsolete_files_period_micros: 21600000000
[2021-12-23 06:58:47.380192] INFO  [25571] [XENGINE] Dump(db_options.cc:341)                   Options.stats_dump_period_sec: 600
[2021-12-23 06:58:47.380197] INFO  [25571] [XENGINE] Dump(db_options.cc:344)             Options.batch_group_slot_array_size: 5
[2021-12-23 06:58:47.380203] INFO  [25571] [XENGINE] Dump(db_options.cc:347)              Options.batch_group_max_group_size: 80
[2021-12-23 06:58:47.380208] INFO  [25571] [XENGINE] Dump(db_options.cc:350)     Options.batch_group_max_leader_wait_time_us: 200
[2021-12-23 06:58:47.380214] INFO  [25571] [XENGINE] Dump(db_options.cc:353)     Options.concurrent_writable_file_buffer_num: 4
[2021-12-23 06:58:47.380219] INFO  [25571] [XENGINE] Dump(db_options.cc:356) Options.concurrent_writable_file_single_buffer_size: 4194304
[2021-12-23 06:58:47.380225] INFO  [25571] [XENGINE] Dump(db_options.cc:359) Options.concurrent_writable_file_buffer_switch_limit: 524288
[2021-12-23 06:58:47.380231] INFO  [25571] [XENGINE] Dump(db_options.cc:362)                Options.use_direct_write_for_wal: 1
[2021-12-23 06:58:47.380236] INFO  [25571] [XENGINE] Dump(db_options.cc:365)                  Options.query_trace_enable_count: 1
[2021-12-23 06:58:47.380242] INFO  [25571] [XENGINE] Dump(db_options.cc:368)                 Options.query_trace_print_stats: 0
[2021-12-23 06:58:47.380248] INFO  [25571] [XENGINE] Dump(db_options.cc:371)            Options.mutex_backtrace_threshold_ns: 100000000
[2021-12-23 06:58:47.380253] INFO  [25571] [XENGINE] Dump(db_options.cc:374)            Options.auto_shrink_enabled: 1)
[2021-12-23 06:58:47.380259] INFO  [25571] [XENGINE] Dump(db_options.cc:377)            Options.max_free_extent_percent: 10)
[2021-12-23 06:58:47.380265] INFO  [25571] [XENGINE] Dump(db_options.cc:380)            Options.shrink_allocate_interval: 3600)
[2021-12-23 06:58:47.380270] INFO  [25571] [XENGINE] Dump(db_options.cc:383)            Options.max_shrink_extent_count: 512)
[2021-12-23 06:58:47.380276] INFO  [25571] [XENGINE] Dump(db_options.cc:386)            Options.total_max_shrink_extent_count: 7680)
[2021-12-23 06:58:47.380281] INFO  [25571] [XENGINE] Dump(db_options.cc:389)            Options.idle_tasks_schedule_time: 60)
[2021-12-23 06:58:47.380287] INFO  [25571] [XENGINE] Dump(db_options.cc:392)            Options.auto_shrink_schedule_interval: 3600)
[2021-12-23 06:58:47.380293] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:157) Compression algorithms supported:
[2021-12-23 06:58:47.380299] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:158)    Snappy supported: 0
[2021-12-23 06:58:47.380305] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:159)    Zlib supported: 0
[2021-12-23 06:58:47.380310] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:160)    Bzip supported: 0
[2021-12-23 06:58:47.380316] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:161)    LZ4 supported: 0
[2021-12-23 06:58:47.380322] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:162)    ZSTD supported: 0
[2021-12-23 06:58:47.380327] INFO  [25571] [XENGINE] DumpSupportInfo(db_impl.cc:164) Fast CRC32 supported:

请问支持存算分离（分离到oss) + 一写多读的版本是否有开源的时间点

ARM 服务器编译 DN 失败

平台：Linux 4.19.90-2003.4.0.0036.oe1.aarch64 #1 SMP Mon Mar 23 19:06:43 UTC 2020 aarch64 aarch64 aarch64 GNU/Linux
gcc: gcc (GCC) 10.2.1
报错信息：

/usr/include/c++/10/bits/hashtable.h: In instantiation of ‘class std::_Hashtable<long int, std::pair<const long int, xengine::storage::AsyncRandomAccessExtent*>, xengine::memory::stl_adapt_allocator<std::pair<long int, xengine::storage::AsyncRandomAccessExtent*>, 14>, std::__detail::_Select1st, std::equal_to, std::hash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, false, true> >’:
/usr/include/c++/10/bits/unordered_map.h:105:18: required from ‘class std::unordered_map<long int, xengine::storage::AsyncRandomAccessExtent*, std::hash, std::equal_to, xengine::memory::stl_adapt_allocator<std::pair<long int, xengine::storage::AsyncRandomAccessExtent*>, 14> >’
middleware/galaxyengine/storage/xengine/core/compact/compaction.h:589:21: required from here
/usr/include/c++/10/bits/hashtable.h:192:21: error: static assertion failed: unordered container must have the same value_type as its allocator
192 | static_assert(is_same<typename _Alloc::value_type, _Value>{},
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
cc1plus: all warnings being treated as errors
make[2]: *** [storage/xengine/CMakeFiles/xengine_se.dir/build.make:80: storage/xengine/CMakeFiles/xengine_se.dir/handler/ha_xengine.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:5298: storage/xengine/CMakeFiles/xengine_se.dir/all] Error 2
make: *** [Makefile:180: all] Error 2
你好，在上述服务器环境，遇到了同样的问题，请问有没有快速修复的方法？ #5

TRUE & FALSE not defined

You have lost you TRUE AND FALSE defined in my_global.h file

#ifndef MY_GLOBAL_INCLUDED
#define MY_GLOBAL_INCLUDED

/* Define some general constants /
#ifndef TRUE
#define TRUE (1) / Logical true /
#define FALSE (0) / Logical false */
#endif

#endif // MY_GLOBAL_INCLUDED

‘TRUE’ was not declared in this scope

The lastest commit log is

commit 99986fccd58f8bdad0c59145a122ace52a812338 (HEAD -> main, origin/main, origin/HEAD)
Author: [email protected] <[email protected]>
Date:   Wed Oct 20 20:21:19 2021 +0800

    [Bugfix] Fix build warning

The error message of make -j8 is

[ 78%] Building CXX object sql/CMakeFiles/sql_main.dir/trans_proc/implicit_savepoint.cc.o
In file included from /home/ubuntu/develop/galaxyengine/include/template_utils.h:28:0,
                 from /home/ubuntu/develop/galaxyengine/include/m_ctype.h:46,
                 from /home/ubuntu/develop/galaxyengine/sql/sql_parse.h:30,
                 from /home/ubuntu/develop/galaxyengine/sql/trans_proc/implicit_savepoint.cc:21:
/home/ubuntu/develop/galaxyengine/sql/trans_proc/implicit_savepoint.cc: In member function ‘virtual bool im::Sql_cmd_trans_proc_implicit_savepoint::pc_execute(THD*)’:
/home/ubuntu/develop/galaxyengine/sql/trans_proc/implicit_savepoint.cc:59:17: error: ‘TRUE’ was not declared in this scope
     DBUG_RETURN(TRUE);
                 ^
/home/ubuntu/develop/galaxyengine/include/my_dbug.h:156:13: note: in definition of macro ‘DBUG_RETURN’
     return (a1);                              \
             ^~
/home/ubuntu/develop/galaxyengine/sql/trans_proc/implicit_savepoint.cc:65:17: error: ‘TRUE’ was not declared in this scope
     DBUG_RETURN(TRUE);

Fail to start using RPM version

2024-01-23T10:00:18.121555Z 0 [System] [MY-010116] [Server] /opt/polardbx_engine/bin/mysqld (mysqld 8.0.30) starting as process 31462
2024-01-23T10:00:18.176262Z 1 [System] [MY-011012] [Server] Starting upgrade of data directory.
2024-01-23T10:00:18.177084Z 1 [ERROR] [MY-025045] [Lizard] Data file lizard.ibd didn't found when boot InnoDB
2024-01-23T10:00:18.177276Z 1 [ERROR] [MY-011013] [Server] Failed to initialize DD Storage Engine.
2024-01-23T10:00:18.177626Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2024-01-23T10:00:18.177895Z 0 [ERROR] [MY-010119] [Server] Aborting
2024-01-23T10:00:18.189144Z 0 [System] [MY-010910] [Server] /opt/polardbx_engine/bin/mysqld: Shutdown complete (mysqld 8.0.30)  Source distribution.

[Lizard] Data file lizard.ibd didn't found when boot InnoDB

polardb-engine.x86_64版本

Build error in Debian

Build in Debian 10
g++ (Debian 7.4.0-6) 7.4.0
gcc (Debian 7.4.0-6) 7.4.0

Error message is ：
In file included from /root/ApsaraDB/galaxyengine/sql/sys_vars.cc:44:0:
/root/ApsaraDB/galaxyengine/sql/sys_vars.cc:6785:66: error: ‘FALSE’ was not declared in this scope
SESSION_ONLY(sequence_read_skip_cache), NO_CMD_LINE, DEFAULT(FALSE),
^
/root/ApsaraDB/galaxyengine/sql/sys_vars.h:102:20: note: in definition of macro ‘DEFAULT’
#define DEFAULT(X) X
^
/root/ApsaraDB/galaxyengine/sql/sys_vars.cc:6785:66: note: suggested alternative: ‘FILE’
SESSION_ONLY(sequence_read_skip_cache), NO_CMD_LINE, DEFAULT(FALSE),
^
/root/ApsaraDB/galaxyengine/sql/sys_vars.h:102:20: note: in definition of macro ‘DEFAULT’
#define DEFAULT(X) X
^
/root/ApsaraDB/galaxyengine/sql/sys_vars_ext.cc:263:48: error: ‘FALSE’ was not declared in this scope
DEFAULT(FALSE), NO_MUTEX_GUARD,
^
/root/ApsaraDB/galaxyengine/sql/sys_vars.h:102:20: note: in definition of macro ‘DEFAULT’
#define DEFAULT(X) X
^
/root/ApsaraDB/galaxyengine/sql/sys_vars_ext.cc:263:48: note: suggested alternative: ‘FILE’
DEFAULT(FALSE), NO_MUTEX_GUARD,
^
/root/ApsaraDB/galaxyengine/sql/sys_vars.h:102:20: note: in definition of macro ‘DEFAULT’
#define DEFAULT(X) X
^
make[2]: *** [sql/CMakeFiles/sql_main.dir/build.make:3055: sql/CMakeFiles/sql_main.dir/sys_vars.cc.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[1]: *** [CMakeFiles/Makefile2:11487: sql/CMakeFiles/sql_main.dir/all] Error 2
make: *** [Makefile:163: all] Error 2

compile the souce code according the quik start, it report compile error fatal error: easy_log.h: No such file or directory

env

gcc (GCC) 7.3.1 20180303 (Red Hat 7.3.1-5)

compile

cmake .
-DFORCE_INSOURCE_BUILD=ON
-DCMAKE_BUILD_TYPE="Debug"
-DSYSCONFDIR="/u01/mysql"
-DCMAKE_INSTALL_PREFIX="/u01/mysql"
-DMYSQL_DATADIR="/u01/mysql/data"
-DMYSQL_MAINTAINER_MODE=0
-DWITH_SSL=openssl
-DWITH_BOOST="./extra/boost/boost_1_70_0.tar.gz"
make -j1
make install

error log

galaxyengine/sql/../cluster/consensus/paxos.h:28:10: fatal error: easy_log.h: No such file or directory
#include <easy_log.h>
^~~~~~~~~~~~
compilation terminated.