doris 3.0.4 backup数据到oss 失败,怎么解决

Viewed 7

BACKUP SNAPSHOT second_water_supply.test_measure_point_test_bak_day
TO oss_repo1 -- 你的repository名称
ON
(
measure_point PARTITION (p_20251202)
)
PROPERTIES (
"timeout" = "3600",
"type" = "full"
);
我想把doris的历史数据备份到oss里去,上午做了一个测试,我把通过doris的backup工具把一个表一个分区大概10G的数据传上去,doris分成10个文件(每个文件1G)来传,结果传到第三个就报连接超时了,有没有什么参数可以把文件的大小改小点

具体问题如下:
[176xxxxx9475: [INTERNAL_ERROR]error status=[IO_ERROR]failed to upload part (bucket=test, key=s3://test/oss_repo/__palo_repository_oss_repo1/__ss_test_measure_point_test_bak_day/__ss_content/__db_1744776469089/__tbl_1751258307752/__part_1751258352460/__idx_1751258307753/__1751258352477/02000000008e5ff16741014624b6f22d4cb52375351500b2_0.dat.46115de0664783e853cab35b3942d06d, part_num=98, up_load_id=6B7F7A706BB8417483FB58511C657737): curlCode: 28, Timeout was reached, exception , error code -1 failed=true #complete_parts=210 #expected_parts=211 completed_parts_list=part_numbers: 3 1 66 2 65 67 25 52 37 32 45 9 13 70 44 34 15 39 5 31 42 62 60 7 21 55 8 26 10 68 14 56 4 28 38 12 35 11 53 24 27 6 43 63 30 64 18 61 69 41 17 50 48 22 19 29 23 47 75 74 33 57 54 58 91 46 20 81 59 73 76 51 40 110 49 16 36 84 109 89 87 93 101 129 119 85 92 86 111 123 106 72 90 80 79 107 112 71 105 103 78 124 126 117 97 100 134 125 130 135 83 122 88 116 128 108 113 104 114 82 136 137 151 96 133 99 94 120 140 102 147 95 144 121 132 115 139 142 138 154 131 127 185 150 165 145 152 168 149 155 77 179 211 169 176 146 180 173 153 143 171 187 158 190 177 163 197 167 164 157 202 166 118 156 172 200 207 182 160 178 159 201 162 203 206 161 174 194 186 205 188 183 170 196 189 192 209 181 195 199 141 198 184 204 191 148 193 175 208 210 file_path=s3://test/oss_repo/__palo_repository_oss_repo1/__ss_test_measure_point_test_bak_day/__ss_content/__db_1744776469089/__tbl_1751258307752/__part_1751258352460/__idx_1751258307753/__1751258352477/02000000008e5ff16741014624b6f22d4cb52375351500b2_0.dat.46115de0664783e853cab35b3942d06d file_size=1101954107 has left buffer not uploaded=false]

1 Answers

主要是文件太大,导致上传oss超时