Doris 3.1.4 版本连表语句多次查询结果均不一致问题:
当前版本是从最初的 1.x 版本 先升级到 2.1.0 后出现查询不一致的情况,然后再逐步升级到 3.1.4 版本,这种情况一直存在,一直未解决
单表的操作无任何异常问题
a) 连表语句:SELECT distinct bar_code from online_quality_test.t_export_table where bar_code not in (SELECT distinct bar_code FROM online_quality.t_inv_record );
5 次查询结果不一致(查N次大多都不一致):-- 56811 -- 56863 -- 57312 -- 57046 -- 57010
b) 外表查询语句:SELECT count(distinct bar_code) from online_quality_test.t_export_table
多次查询结果不变:175554
c) 子查询语句:SELECT count(distinct bar_code) FROM online_quality.t_inv_record;
多次查询结果不变:145845935
d) 外表表结构:
CREATE TABLE t_export_table (
bar_code varchar(64) NOT NULL COMMENT "...",
... ...
) ENGINE=OLAP
UNIQUE KEY(bar_code)
COMMENT '......'
DISTRIBUTED BY HASH(bar_code) BUCKETS 32
PROPERTIES (
"replication_allocation" = "tag.location.default: 3",
"min_load_replica_num" = "-1",
"is_being_synced" = "false",
"storage_medium" = "hdd",
"storage_format" = "V2",
"inverted_index_storage_format" = "DEFAULT",
"enable_unique_key_merge_on_write" = "false",
"light_schema_change" = "true",
"disable_auto_compaction" = "false",
"enable_single_replica_compaction" = "false",
"group_commit_interval_ms" = "10000",
"group_commit_data_bytes" = "134217728"
);
e) 内表表结构:
CREATE TABLE t_inv_record (
bar_code varchar(128) NOT NULL DEFAULT "" COMMENT "...",
... ...
) ENGINE=OLAP
UNIQUE KEY(... ...)
COMMENT '.......'
PARTITION BY LIST (country)
(PARTITION country_26 VALUES IN ("..."),
... ...
PARTITION country_41 VALUES IN ("..."))
DISTRIBUTED BY HASH(... ...) BUCKETS 96
PROPERTIES (
"replication_allocation" = "tag.location.default: 3",
"min_load_replica_num" = "-1",
"is_being_synced" = "false",
"colocate_with" = "country,operator,site_name,cabinet_num,frame_num,slot_num",
"storage_medium" = "hdd",
"storage_format" = "V2",
"inverted_index_storage_format" = "DEFAULT",
"enable_unique_key_merge_on_write" = "false",
"light_schema_change" = "true",
"disable_auto_compaction" = "false",
"enable_single_replica_compaction" = "false",
"group_commit_interval_ms" = "10000",
"group_commit_data_bytes" = "134217728"
);
f) BE/FE 节点以及服务器架构分布情况
| 节点 | 架构 |
|---|---|
| 84 | x86 FE+BE |
| 61 | x86 FE+BE |
| 57 | ARM FE+BE |
| 50 | x86 FE+BE |
| 34 | x86 BE |