Doris 2.1.9 be.out文件体积异常大 100G-200G

Viewed 15

当前版本:2.1.9
问题起因是今天有一个be发生了重启,在查看be.out文件的时候发现大小异常。
做了资源划分,相同资源组的be节点也存在该现象。(该资源组内streamload任务较多)
image.png
image.png
其他资源组看起来文件大小是正常的
image.png
查看文件内容,发现存在大量的重复行
image.png

/home/zcp/repo_center/doris_branch-2.1/doris/thirdparty/src/re2-2021-02-02/re2/re2.cc:748: DFA out of memory: pattern length 366376, program size 1565
51, list count 146638, bytemap range 54
/home/zcp/repo_center/doris_branch-2.1/doris/thirdparty/src/re2-2021-02-02/re2/re2.cc:748: DFA out of memory: pattern length 366376, program size 1565
51, list count 146638, bytemap range 54
/home/zcp/repo_center/doris_branch-2.1/doris/thirdparty/src/re2-2021-02-02/re2/re2.cc:748: DFA out of memory: pattern length 366376, program size 1565
51, list count 146638, bytemap range 54
/home/zcp/repo_center/doris_branch-2.1/doris/thirdparty/src/re2-2021-02-02/re2/re2.cc:748: DFA out of memory: pattern length 366376, program size 1565
51, list count 146638, bytemap range 54
/home/zcp/repo_center/doris_branch-2.1/doris/thirdparty/src/re2-2021-02-02/re2/re2.cc:748: DFA out of memory: pattern length 366376, program size 1565
51, list count 146638, bytemap range 54
/home/zcp/repo_center/doris_branch-2.1/doris/thirdparty/src/re2-2021-02-02/re2/re2.cc:748: DFA out of memory: pattern length 366376, program size 1565
51, list count 146638, bytemap range 54

在搜索时发现之前有人提出过这个问题,但是没有回应。
https://github.com/apache/doris/issues/27457
另外还发现一个re2的提问,不知道有用没。
https://github.com/google/re2/issues/186

0 Answers