在ranger新增了表权限,使用DBeaver连接,用户有所有表的权限,不仅仅是指定表。用户账号是新创建的,在DBeaver中使用root账号创建的账号。在fe服务器上/data/doris/ranger/cache的doris_doris.json文件中有这个配置。给这个账号还加了行权限,行权限生效。


在ranger新增了表权限,使用DBeaver连接,用户有所有表的权限,不仅仅是指定表。用户账号是新创建的,在DBeaver中使用root账号创建的账号。在fe服务器上/data/doris/ranger/cache的doris_doris.json文件中有这个配置。给这个账号还加了行权限,行权限生效。


ranger 设置权限后,可能有个时间周期,Doris会向ranger拉取最新的权限信息,可能得德等一会,如果说等待一段时间后还是没有权限,这个需要排查下,您可能需要提供下 /ranger/cache 下的文件,以及fe.log的日志信息。
您可以加我主页微信私发给我。
doris_doris.json
{
"serviceName": "doris",
"serviceId": 1,
"policyVersion": 49,
"policyUpdateTime": "20260930-15:41:00.000-+0800",
"policies": [
{
"id": 1,
"guid": "4f3c320e-92e7-4659-9c46-4f21263d42db",
"isEnabled": true,
"version": 5,
"service": "doris",
"name": "all - catalog, database",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - catalog, database",
"isAuditEnabled": true,
"resources": {
"database": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"catalog": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "ALTER",
"isAllowed": true
},
{
"type": "GRANT",
"isAllowed": true
},
{
"type": "CREATE",
"isAllowed": true
},
{
"type": "LOAD",
"isAllowed": true
},
{
"type": "SHOW",
"isAllowed": true
},
{
"type": "SELECT",
"isAllowed": true
},
{
"type": "SHOW_VIEW",
"isAllowed": true
},
{
"type": "DROP",
"isAllowed": true
}
],
"users": [
"root",
"ti",
"Gqq"
],
"groups": [
"public"
],
"conditions": [
{
"type": "_expression",
"values": [
"1==1"
]
}
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 2,
"guid": "c41cacce-5e31-43c3-8a95-79b97deb33ab",
"isEnabled": true,
"version": 3,
"service": "doris",
"name": "all - resource",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - resource",
"isAuditEnabled": true,
"resources": {
"resource": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "USAGE",
"isAllowed": true
}
],
"users": [
"root",
"Gqq",
"ti"
],
"groups": [
"public"
],
"conditions": [
{
"type": "_expression",
"values": [
"1==1"
]
}
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 3,
"guid": "420f3d71-8a56-4fee-a90d-0dd4b182ded0",
"isEnabled": true,
"version": 1,
"service": "doris",
"name": "all - compute_group",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - compute_group",
"isAuditEnabled": true,
"resources": {
"compute_group": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "USAGE",
"isAllowed": true
}
],
"users": [
"root"
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 4,
"guid": "d218acda-363a-4f76-8a31-d54c6f99b83f",
"isEnabled": true,
"version": 8,
"service": "doris",
"name": "all - global",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - global",
"isAuditEnabled": true,
"resources": {
"global": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "ADMIN",
"isAllowed": true
},
{
"type": "NODE",
"isAllowed": true
},
{
"type": "GRANT",
"isAllowed": true
},
{
"type": "SELECT",
"isAllowed": true
},
{
"type": "LOAD",
"isAllowed": true
},
{
"type": "ALTER",
"isAllowed": true
},
{
"type": "CREATE",
"isAllowed": true
},
{
"type": "DROP",
"isAllowed": true
},
{
"type": "SHOW_VIEW",
"isAllowed": true
},
{
"type": "SHOW",
"isAllowed": true
}
],
"users": [
"admin"
],
"groups": [
"public"
],
"conditions": [
{
"type": "_expression",
"values": [
"1==1"
]
}
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 5,
"guid": "7591e016-6e5f-4e0e-b21f-336eca26d090",
"isEnabled": true,
"version": 5,
"service": "doris",
"name": "all - catalog, database, table, column",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - catalog, database, table, column",
"isAuditEnabled": true,
"resources": {
"column": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"database": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"catalog": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"table": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "SELECT",
"isAllowed": true
}
],
"users": [
"root",
"ti"
],
"groups": [
"public"
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 6,
"guid": "4505c3fb-2d53-4d91-9bcc-81b73d5d4739",
"isEnabled": true,
"version": 1,
"service": "doris",
"name": "all - workload_group",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - workload_group",
"isAuditEnabled": true,
"resources": {
"workload_group": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "USAGE",
"isAllowed": true
}
],
"users": [
"root"
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 7,
"guid": "6918445e-aee6-4c9c-a2cc-7ac797d3400b",
"isEnabled": true,
"version": 1,
"service": "doris",
"name": "all - catalog, database, table",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - catalog, database, table",
"isAuditEnabled": true,
"resources": {
"database": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"catalog": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"table": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "GRANT",
"isAllowed": true
},
{
"type": "SELECT",
"isAllowed": true
},
{
"type": "LOAD",
"isAllowed": true
},
{
"type": "ALTER",
"isAllowed": true
},
{
"type": "CREATE",
"isAllowed": true
},
{
"type": "DROP",
"isAllowed": true
},
{
"type": "SHOW_VIEW",
"isAllowed": true
},
{
"type": "SHOW",
"isAllowed": true
}
],
"users": [
"root"
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 8,
"guid": "956cdf2e-832d-4728-a7d5-527b1db155b4",
"isEnabled": true,
"version": 3,
"service": "doris",
"name": "all - catalog",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - catalog",
"isAuditEnabled": true,
"resources": {
"catalog": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "GRANT",
"isAllowed": true
},
{
"type": "SELECT",
"isAllowed": true
},
{
"type": "LOAD",
"isAllowed": true
},
{
"type": "ALTER",
"isAllowed": true
},
{
"type": "CREATE",
"isAllowed": true
},
{
"type": "DROP",
"isAllowed": true
},
{
"type": "SHOW_VIEW",
"isAllowed": true
},
{
"type": "SHOW",
"isAllowed": true
}
],
"users": [
"root",
"ti"
],
"groups": [
"public"
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 9,
"guid": "5c8919ee-5844-4a5e-ac1f-5e311bdb1293",
"isEnabled": true,
"version": 1,
"service": "doris",
"name": "all - storage_vault",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for all - storage_vault",
"isAuditEnabled": true,
"resources": {
"storage_vault": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "USAGE",
"isAllowed": true
}
],
"users": [
"root"
],
"delegateAdmin": true
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 12,
"guid": "12cdcd96-b7b0-4f38-85ef-c0ab665b1651",
"isEnabled": true,
"version": 1,
"service": "doris",
"name": "1002库存管理",
"policyType": 2,
"policyPriority": 0,
"isAuditEnabled": true,
"resources": {
"database": {
"values": [
"dwdb"
],
"isExcludes": false,
"isRecursive": false
},
"catalog": {
"values": [
"internal"
],
"isExcludes": false,
"isRecursive": false
},
"table": {
"values": [
"dws_inventory_age_valuation"
],
"isExcludes": false,
"isRecursive": false
}
},
"rowFilterPolicyItems": [
{
"accesses": [
{
"type": "SELECT",
"isAllowed": true
}
],
"users": [
"Grr"
],
"delegateAdmin": false,
"rowFilterInfo": {
"filterExpr": "bu_id = 1002"
}
}
],
"serviceType": "doris",
"isDenyAllElse": false
},
{
"id": 13,
"guid": "10d7b6bb-6514-4b80-a1e7-0d75d0a66a12",
"isEnabled": true,
"version": 4,
"service": "doris",
"name": "库存管理员",
"policyType": 0,
"policyPriority": 0,
"isAuditEnabled": true,
"resources": {
"database": {
"values": [
"dwdb"
],
"isExcludes": false,
"isRecursive": false
},
"catalog": {
"values": [
""
],
"isExcludes": false,
"isRecursive": false
},
"table": {
"values": [
"dws_inventory_age_valuation"
],
"isExcludes": false,
"isRecursive": false
}
},
"policyItems": [
{
"accesses": [
{
"type": "SELECT",
"isAllowed": true
}
],
"users": [
"Grr"
],
"delegateAdmin": false
}
],
"serviceType": "doris",
"isDenyAllElse": false
}
],
"serviceDef": {
"id": 206,
"guid": "ac24538f-2bf1-41ad-b7b0-324a5b4ac785",
"isEnabled": true,
"createdBy": "Admin",
"updatedBy": "Admin",
"createTime": "20260909-11:38:56.000-+0800",
"updateTime": "20260909-11:38:56.000-+0800",
"version": 1,
"name": "doris",
"displayName": "Apache Doris",
"implClass": "org.apache.ranger.services.doris.RangerServiceDoris",
"label": "Doris",
"description": "Apache Doris",
"options": {
"enableDenyAndExceptionsInPolicies": "true",
"enableTagBasedPolicies": "true"
},
"configs": [
{
"itemId": 1,
"name": "username",
"type": "string",
"mandatory": true,
"label": "Username"
},
{
"itemId": 2,
"name": "password",
"type": "password",
"mandatory": false,
"label": "Password"
},
{
"itemId": 3,
"name": "jdbc.driver_class",
"type": "string",
"mandatory": true,
"defaultValue": "com.mysql.cj.jdbc.Driver"
},
{
"itemId": 4,
"name": "jdbc.url",
"type": "string",
"mandatory": true
}
],
"resources": [
{
"itemId": 1,
"name": "catalog",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Catalog",
"description": "Doris Catalog",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": true
},
{
"itemId": 5,
"name": "resource",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Resource",
"description": "Doris Resource",
"accessTypeRestrictions": [
"USAGE"
],
"isValidLeaf": true
},
{
"itemId": 6,
"name": "workload_group",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Workload Group",
"description": "Doris Workload Group",
"accessTypeRestrictions": [
"USAGE"
],
"isValidLeaf": true
},
{
"itemId": 7,
"name": "global",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": false,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Global",
"description": "Doris Global",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"NODE",
"ADMIN",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": true
},
{
"itemId": 8,
"name": "compute_group",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Compute Group",
"description": "Doris Compute Group",
"accessTypeRestrictions": [
"USAGE"
],
"isValidLeaf": true
},
{
"itemId": 9,
"name": "storage_vault",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Storage Vault",
"description": "Doris Storage Vault",
"accessTypeRestrictions": [
"USAGE"
],
"isValidLeaf": true
},
{
"itemId": 2,
"name": "database",
"type": "string",
"level": 20,
"parent": "catalog",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Database",
"description": "Doris Database",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": true
},
{
"itemId": 3,
"name": "table",
"type": "string",
"level": 30,
"parent": "database",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Table",
"description": "Doris Table",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": true
},
{
"itemId": 4,
"name": "column",
"type": "string",
"level": 40,
"parent": "table",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": true,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"label": "Doris Column",
"description": "Doris Column",
"accessTypeRestrictions": [
"SELECT"
],
"isValidLeaf": true
}
],
"accessTypes": [
{
"itemId": 1,
"name": "ADMIN",
"label": "ADMIN"
},
{
"itemId": 2,
"name": "NODE",
"label": "NODE"
},
{
"itemId": 3,
"name": "GRANT",
"label": "GRANT"
},
{
"itemId": 4,
"name": "SELECT",
"label": "SELECT"
},
{
"itemId": 5,
"name": "LOAD",
"label": "LOAD"
},
{
"itemId": 6,
"name": "ALTER",
"label": "ALTER"
},
{
"itemId": 7,
"name": "CREATE",
"label": "CREATE"
},
{
"itemId": 8,
"name": "DROP",
"label": "DROP"
},
{
"itemId": 9,
"name": "SHOW_VIEW",
"label": "SHOW_VIEW"
},
{
"itemId": 10,
"name": "USAGE",
"label": "USAGE"
},
{
"itemId": 11,
"name": "SHOW",
"label": "SHOW"
}
],
"policyConditions": [
{
"itemId": 1,
"name": "_expression",
"evaluator": "org.apache.ranger.plugin.conditionevaluator.RangerScriptConditionEvaluator",
"evaluatorOptions": {
"engineName": "JavaScript",
"ui.isMultiline": "true"
},
"uiHint": "{ "isMultiline":true }",
"label": "Enter boolean expression",
"description": "Boolean expression"
}
],
"dataMaskDef": {
"maskTypes": [
{
"itemId": 1,
"name": "MASK",
"label": "Redact",
"description": "Replace lowercase with 'x', uppercase with 'X', digits with '0'",
"transformer": "regexp_replace(regexp_replace(regexp_replace({col},'([A-Z])', 'x'),'([a-z])','x'),'([0-9])','n')"
},
{
"itemId": 2,
"name": "MASK_SHOW_LAST_4",
"label": "Partial mask: show last 4",
"description": "Show last 4 characters; replace rest with 'X'",
"transformer": "LPAD(RIGHT({col}, 4), CHAR_LENGTH({col}), 'X')"
},
{
"itemId": 3,
"name": "MASK_SHOW_FIRST_4",
"label": "Partial mask: show first 4",
"description": "Show first 4 characters; replace rest with 'x'",
"transformer": "RPAD(LEFT({col}, 4), CHAR_LENGTH({col}), 'X')"
},
{
"itemId": 4,
"name": "MASK_HASH",
"label": "Hash",
"description": "Hash the value of a varchar with sha256",
"transformer": "hex(sha2({col}, 256))"
},
{
"itemId": 5,
"name": "MASK_NULL",
"label": "Nullify",
"description": "Replace with NULL"
},
{
"itemId": 6,
"name": "MASK_NONE",
"label": "Unmasked (retain original value)",
"description": "No masking"
},
{
"itemId": 12,
"name": "MASK_DATE_SHOW_YEAR",
"label": "Date: show only year",
"description": "Date: show only year",
"transformer": "date_trunc({col}, 'year')"
},
{
"itemId": 13,
"name": "CUSTOM",
"label": "Custom",
"description": "Custom"
}
],
"accessTypes": [
{
"itemId": 4,
"name": "SELECT",
"label": "SELECT"
}
],
"resources": [
{
"itemId": 1,
"name": "catalog",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Catalog",
"description": "Doris Catalog",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": false
},
{
"itemId": 2,
"name": "database",
"type": "string",
"level": 20,
"parent": "catalog",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Database",
"description": "Doris Database",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": false
},
{
"itemId": 3,
"name": "table",
"type": "string",
"level": 30,
"parent": "database",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Table",
"description": "Doris Table",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": false
},
{
"itemId": 4,
"name": "column",
"type": "string",
"level": 40,
"parent": "table",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Column",
"description": "Doris Column",
"accessTypeRestrictions": [
"SELECT"
],
"isValidLeaf": true
}
]
},
"rowFilterDef": {
"accessTypes": [
{
"itemId": 4,
"name": "SELECT",
"label": "SELECT"
}
],
"resources": [
{
"itemId": 1,
"name": "catalog",
"type": "string",
"level": 10,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Catalog",
"description": "Doris Catalog",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": false
},
{
"itemId": 2,
"name": "database",
"type": "string",
"level": 20,
"parent": "catalog",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Database",
"description": "Doris Database",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": false
},
{
"itemId": 3,
"name": "table",
"type": "string",
"level": 30,
"parent": "database",
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "true",
"ignoreCase": "true"
},
"uiHint": "{ "singleValue":true }",
"label": "Doris Table",
"description": "Doris Table",
"accessTypeRestrictions": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
],
"isValidLeaf": true
}
]
},
"markerAccessTypes": [
{
"itemId": 12,
"name": "_CREATE",
"label": "_CREATE"
},
{
"itemId": 13,
"name": "_READ",
"label": "_READ"
},
{
"itemId": 14,
"name": "_UPDATE",
"label": "_UPDATE"
},
{
"itemId": 15,
"name": "_DELETE",
"label": "_DELETE"
},
{
"itemId": 16,
"name": "_MANAGE",
"label": "_MANAGE"
},
{
"itemId": 17,
"name": "_ALL",
"label": "_ALL",
"impliedGrants": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"USAGE",
"NODE",
"ADMIN",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
]
}
]
},
"auditMode": "audit-default",
"tagPolicies": {
"serviceName": "tag",
"serviceId": 2,
"policyVersion": 11,
"policyUpdateTime": "20260930-15:41:00.000-+0800",
"policies": [
{
"id": 10,
"guid": "9285cf52-de90-4579-9f31-86bed9402c39",
"isEnabled": true,
"version": 1,
"service": "tag",
"name": "EXPIRES_ON",
"policyType": 0,
"policyPriority": 0,
"description": "Policy for data with EXPIRES_ON tag",
"isAuditEnabled": true,
"resources": {
"tag": {
"values": [
"EXPIRES_ON"
],
"isExcludes": false,
"isRecursive": false
}
},
"denyPolicyItems": [
{
"accesses": [
{
"type": "ADMIN",
"isAllowed": true
},
{
"type": "NODE",
"isAllowed": true
},
{
"type": "GRANT",
"isAllowed": true
},
{
"type": "SELECT",
"isAllowed": true
},
{
"type": "LOAD",
"isAllowed": true
},
{
"type": "ALTER",
"isAllowed": true
},
{
"type": "CREATE",
"isAllowed": true
},
{
"type": "DROP",
"isAllowed": true
},
{
"type": "SHOW_VIEW",
"isAllowed": true
},
{
"type": "USAGE",
"isAllowed": true
},
{
"type": "SHOW",
"isAllowed": true
}
],
"groups": [
"public"
],
"conditions": [
{
"type": "accessed-after-expiry",
"values": [
"yes"
]
}
],
"delegateAdmin": false
}
],
"serviceType": "tag",
"isDenyAllElse": false
}
],
"serviceDef": {
"id": 100,
"guid": "0d047248-baff-4cf9-8e9e-d5d377284b2e",
"isEnabled": true,
"createdBy": "Admin",
"updatedBy": "Admin",
"createTime": "20260908-22:42:44.000-+0800",
"updateTime": "20260909-11:38:56.000-+0800",
"version": 24,
"name": "tag",
"displayName": "tag",
"implClass": "org.apache.ranger.services.tag.RangerServiceTag",
"label": "TAG",
"description": "TAG Service Definition",
"options": {
"ui.pages": "tag-based-policies",
"enableDenyAndExceptionsInPolicies": "true",
"enableTagBasedPolicies": "true"
},
"configs": [
{
"itemId": 1,
"name": "ranger.plugin.audit.filters",
"type": "string",
"mandatory": false,
"defaultValue": "[ {'accessResult': 'DENIED', 'isAudited': true} ]",
"label": "Ranger Default Audit Filters"
}
],
"resources": [
{
"itemId": 1,
"name": "tag",
"type": "string",
"level": 1,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"wildCard": "false",
"ignoreCase": "false"
},
"uiHint": "{ "singleValue":true }",
"label": "TAG",
"description": "TAG",
"isValidLeaf": true
}
],
"accessTypes": [
{
"itemId": 206207,
"name": "ADMIN",
"label": "ADMIN"
},
{
"itemId": 206208,
"name": "NODE",
"label": "NODE"
},
{
"itemId": 206209,
"name": "GRANT",
"label": "GRANT"
},
{
"itemId": 206210,
"name": "SELECT",
"label": "SELECT"
},
{
"itemId": 206211,
"name": "LOAD",
"label": "LOAD"
},
{
"itemId": 206212,
"name": "ALTER",
"label": "ALTER"
},
{
"itemId": 206213,
"name": "CREATE",
"label": "CREATE"
},
{
"itemId": 206214,
"name": "DROP",
"label": "DROP"
},
{
"itemId": 206215,
"name": "SHOW_VIEW",
"label": "SHOW_VIEW"
},
{
"itemId": 206216,
"name": "USAGE",
"label": "USAGE"
},
{
"itemId": 206217,
"name": "SHOW",
"label": "SHOW"
}
],
"policyConditions": [
{
"itemId": 1,
"name": "accessed-after-expiry",
"evaluator": "org.apache.ranger.plugin.conditionevaluator.RangerScriptTemplateConditionEvaluator",
"evaluatorOptions": {
"scriptTemplate": "ctx.isAccessedAfter('expiry_date');"
},
"uiHint": "{ "singleValue":true }",
"label": "Accessed after expiry_date (yes/no)?",
"description": "Accessed after expiry_date? (yes/no)"
},
{
"itemId": 2,
"name": "expression",
"evaluator": "org.apache.ranger.plugin.conditionevaluator.RangerScriptConditionEvaluator",
"evaluatorOptions": {
"engineName": "JavaScript",
"ui.isMultiline": "true"
},
"uiHint": "{ "isMultiline":true }",
"label": "Enter boolean expression",
"description": "Boolean expression"
}
],
"contextEnrichers": [
{
"itemId": 1,
"name": "TagEnricher",
"enricher": "org.apache.ranger.plugin.contextenricher.RangerTagEnricher",
"enricherOptions": {
"tagRetrieverClassName": "org.apache.ranger.plugin.contextenricher.RangerAdminTagRetriever",
"tagRefresherPollingInterval": "60000"
}
}
],
"dataMaskDef": {
"maskTypes": [
{
"itemId": 3004,
"name": "hive:MASK",
"label": "Redact",
"description": "Replace lowercase with 'x', uppercase with 'X', digits with '0'",
"transformer": "mask({col})"
},
{
"itemId": 3005,
"name": "hive:MASK_SHOW_LAST_4",
"label": "Partial mask: show last 4",
"description": "Show last 4 characters; replace rest with 'x'",
"transformer": "mask_show_last_n({col}, 4, 'x', 'x', 'x', -1, '1')"
},
{
"itemId": 3006,
"name": "hive:MASK_SHOW_FIRST_4",
"label": "Partial mask: show first 4",
"description": "Show first 4 characters; replace rest with 'x'",
"transformer": "mask_show_first_n({col}, 4, 'x', 'x', 'x', -1, '1')"
},
{
"itemId": 3007,
"name": "hive:MASK_HASH",
"label": "Hash",
"description": "Hash the value",
"transformer": "mask_hash({col})"
},
{
"itemId": 3008,
"name": "hive:MASK_NULL",
"label": "Nullify",
"description": "Replace with NULL"
},
{
"itemId": 3009,
"name": "hive:MASK_NONE",
"label": "Unmasked (retain original value)",
"description": "No masking"
},
{
"itemId": 3015,
"name": "hive:MASK_DATE_SHOW_YEAR",
"label": "Date: show only year",
"description": "Date: show only year",
"transformer": "mask({col}, 'x', 'x', 'x', -1, '1', 1, 0, -1)"
},
{
"itemId": 3016,
"name": "hive:CUSTOM",
"label": "Custom",
"description": "Custom"
},
{
"itemId": 203204,
"name": "trino:MASK",
"label": "Redact",
"description": "Replace lowercase with 'x', uppercase with 'X', digits with '0'",
"transformer": "cast(regexp_replace(regexp_replace(regexp_replace({col},'([A-Z])', 'X'),'([a-z])','x'),'([0-9])','0') as {type})"
},
{
"itemId": 203205,
"name": "trino:MASK_SHOW_LAST_4",
"label": "Partial mask: show last 4",
"description": "Show last 4 characters; replace rest with 'X'",
"transformer": "cast(regexp_replace({col}, '(.)(.{4}$)', x -> regexp_replace(x[1], '.', 'X') || x[2]) as {type})"
},
{
"itemId": 203206,
"name": "trino:MASK_SHOW_FIRST_4",
"label": "Partial mask: show first 4",
"description": "Show first 4 characters; replace rest with 'x'",
"transformer": "cast(regexp_replace({col}, '(^.{4})(.)', x -> x[1] || regexp_replace(x[2], '.', 'X')) as {type})"
},
{
"itemId": 203207,
"name": "trino:MASK_HASH",
"label": "Hash",
"description": "Hash the value of a varchar with sha256",
"transformer": "cast(to_hex(sha256(to_utf8({col}))) as {type})"
},
{
"itemId": 203208,
"name": "trino:MASK_NULL",
"label": "Nullify",
"description": "Replace with NULL"
},
{
"itemId": 203209,
"name": "trino:MASK_NONE",
"label": "Unmasked (retain original value)",
"description": "No masking"
},
{
"itemId": 203215,
"name": "trino:MASK_DATE_SHOW_YEAR",
"label": "Date: show only year",
"description": "Date: show only year",
"transformer": "date_trunc('year', {col})"
},
{
"itemId": 203216,
"name": "trino:CUSTOM",
"label": "Custom",
"description": "Custom"
},
{
"itemId": 17018,
"name": "presto:MASK",
"label": "Redact",
"description": "Replace lowercase with 'x', uppercase with 'X', digits with '0'",
"transformer": "cast(regexp_replace(regexp_replace(regexp_replace({col},'([A-Z])', 'X'),'([a-z])','x'),'([0-9])','0') as {type})"
},
{
"itemId": 17019,
"name": "presto:MASK_SHOW_LAST_4",
"label": "Partial mask: show last 4",
"description": "Show last 4 characters; replace rest with 'X'",
"transformer": "cast(regexp_replace({col}, '(.)(.{4}$)', x -> regexp_replace(x[1], '.', 'X') || x[2]) as {type})"
},
{
"itemId": 17020,
"name": "presto:MASK_SHOW_FIRST_4",
"label": "Partial mask: show first 4",
"description": "Show first 4 characters; replace rest with 'x'",
"transformer": "cast(regexp_replace({col}, '(^.{4})(.)', x -> x[1] || regexp_replace(x[2], '.', 'X')) as {type})"
},
{
"itemId": 17021,
"name": "presto:MASK_HASH",
"label": "Hash",
"description": "Hash the value of a varchar with sha256",
"transformer": "cast(to_hex(sha256(to_utf8({col}))) as {type})"
},
{
"itemId": 17022,
"name": "presto:MASK_NULL",
"label": "Nullify",
"description": "Replace with NULL"
},
{
"itemId": 17023,
"name": "presto:MASK_NONE",
"label": "Unmasked (retain original value)",
"description": "No masking"
},
{
"itemId": 17029,
"name": "presto:MASK_DATE_SHOW_YEAR",
"label": "Date: show only year",
"description": "Date: show only year",
"transformer": "date_trunc('year', {col})"
},
{
"itemId": 17030,
"name": "presto:CUSTOM",
"label": "Custom",
"description": "Custom"
},
{
"itemId": 204205,
"name": "nestedstructure:MASK",
"label": "Redact",
"description": "Replace lowercase with 'x', uppercase with 'X', digits with '0'",
"transformer": "mask({field})"
},
{
"itemId": 204206,
"name": "nestedstructure:MASK_SHOW_LAST_4",
"label": "Partial mask: show last 4",
"description": "Show last 4 characters; replace rest with 'x'",
"transformer": "mask_show_last_n({field}, 4, 'x', 'x', 'x', -1, '1')"
},
{
"itemId": 204207,
"name": "nestedstructure:MASK_SHOW_FIRST_4",
"label": "Partial mask: show first 4",
"description": "Show first 4 characters; replace rest with 'x'",
"transformer": "mask_show_first_n({field}, 4, 'x', 'x', 'x', -1, '1')"
},
{
"itemId": 204208,
"name": "nestedstructure:MASK_HASH",
"label": "Hash",
"description": "Hash the value",
"transformer": "mask_hash({field})"
},
{
"itemId": 204209,
"name": "nestedstructure:MASK_NULL",
"label": "Nullify",
"description": "Replace with NULL"
},
{
"itemId": 204210,
"name": "nestedstructure:MASK_NONE",
"label": "Unmasked (retain original value)",
"description": "No masking"
},
{
"itemId": 204216,
"name": "nestedstructure:MASK_DATE_SHOW_YEAR",
"label": "Date: show only year",
"description": "Date: show only year",
"transformer": "mask({field}, 'x', 'x', 'x', -1, '1', 1, 0, -1)"
},
{
"itemId": 204217,
"name": "nestedstructure:CUSTOM",
"label": "Custom",
"description": "Custom"
},
{
"itemId": 206207,
"name": "doris:MASK",
"label": "Redact",
"description": "Replace lowercase with 'x', uppercase with 'X', digits with '0'",
"transformer": "regexp_replace(regexp_replace(regexp_replace({col},'([A-Z])', 'x'),'([a-z])','x'),'([0-9])','n')"
},
{
"itemId": 206208,
"name": "doris:MASK_SHOW_LAST_4",
"label": "Partial mask: show last 4",
"description": "Show last 4 characters; replace rest with 'X'",
"transformer": "LPAD(RIGHT({col}, 4), CHAR_LENGTH({col}), 'X')"
},
{
"itemId": 206209,
"name": "doris:MASK_SHOW_FIRST_4",
"label": "Partial mask: show first 4",
"description": "Show first 4 characters; replace rest with 'x'",
"transformer": "RPAD(LEFT({col}, 4), CHAR_LENGTH({col}), 'X')"
},
{
"itemId": 206210,
"name": "doris:MASK_HASH",
"label": "Hash",
"description": "Hash the value of a varchar with sha256",
"transformer": "hex(sha2({col}, 256))"
},
{
"itemId": 206211,
"name": "doris:MASK_NULL",
"label": "Nullify",
"description": "Replace with NULL"
},
{
"itemId": 206212,
"name": "doris:MASK_NONE",
"label": "Unmasked (retain original value)",
"description": "No masking"
},
{
"itemId": 206218,
"name": "doris:MASK_DATE_SHOW_YEAR",
"label": "Date: show only year",
"description": "Date: show only year",
"transformer": "date_trunc({col}, 'year')"
},
{
"itemId": 206219,
"name": "doris:CUSTOM",
"label": "Custom",
"description": "Custom"
}
],
"accessTypes": [
{
"itemId": 206210,
"name": "SELECT",
"label": "SELECT"
}
],
"resources": [
{
"itemId": 1,
"name": "tag",
"type": "string",
"level": 1,
"mandatory": true,
"lookupSupported": true,
"recursiveSupported": false,
"excludesSupported": false,
"matcher": "org.apache.ranger.plugin.resourcematcher.RangerDefaultResourceMatcher",
"matcherOptions": {
"__isValidLeaf": "true",
"wildCard": "false",
"__accessTypeRestrictions": "[]",
"ignoreCase": "false"
},
"uiHint": "{ "singleValue":true }",
"label": "TAG",
"description": "TAG",
"isValidLeaf": true
}
]
},
"rowFilterDef": {},
"markerAccessTypes": [
{
"itemId": 206218,
"name": "_CREATE",
"label": "_CREATE"
},
{
"itemId": 206219,
"name": "_READ",
"label": "_READ"
},
{
"itemId": 206220,
"name": "_UPDATE",
"label": "_UPDATE"
},
{
"itemId": 206221,
"name": "_DELETE",
"label": "_DELETE"
},
{
"itemId": 206222,
"name": "_MANAGE",
"label": "_MANAGE"
},
{
"itemId": 206223,
"name": "_ALL",
"label": "_ALL",
"impliedGrants": [
"ALTER",
"GRANT",
"CREATE",
"LOAD",
"USAGE",
"NODE",
"ADMIN",
"SHOW",
"SELECT",
"SHOW_VIEW",
"DROP"
]
}
]
},
"auditMode": "audit-default",
"serviceConfig": {
"ranger.plugin.audit.filters": "[ {'accessResult': 'DENIED', 'isAudited': true} ]",
"ranger.plugins.conf.mapping.groupname.handler": "org.apache.ranger.ugsyncutil.transform.RegEx",
"ranger.plugins.conf.ldap.groupname.caseconversion": "none",
"ranger.plugins.conf.ldap.username.caseconversion": "none",
"ranger.plugins.conf.mapping.username.handler": "org.apache.ranger.ugsyncutil.transform.RegEx",
"ranger.plugins.conf.mapping.regex.separator": "/"
}
},
"serviceConfig": {
"ranger.plugins.conf.ldap.username.caseconversion": "none",
"ranger.plugins.conf.mapping.username.handler": "org.apache.ranger.ugsyncutil.transform.RegEx",
"ranger.plugins.conf.mapping.regex.separator": "/",
"ranger.plugin.super.groups": "public,group_admin",
"ranger.plugins.conf.mapping.groupname.handler": "org.apache.ranger.ugsyncutil.transform.RegEx",
"ranger.plugins.conf.ldap.groupname.caseconversion": "none",
"ranger.plugin.super.users": "admin"
}
}
fe.log,日志文件就是这段重复日志
2026-10-08 00:00:12,593 INFO (binlog-gcer|75) [BinlogManager.gc():654] begin gc binlog
2026-10-08 00:00:12,593 INFO (binlog-gcer|75) [BinlogManager.gc():665] gc binlog, dbBinlogMap is null
2026-10-08 00:00:12,593 INFO (binlog-gcer|75) [BinlogGcer.runAfterCatalogReady():63] no gc binlog
2026-10-08 00:00:12,774 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:12,774 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:12,826 INFO (thrift-server-pool-3|227) [ReportHandler.handleReport():240] receive report from be 1788852317975. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:12,852 INFO (InsertOverwriteDropDirtyPartitions|95) [InsertOverwriteManager.runAfterCatalogReady():373] start clean insert overwrite temp partitions
2026-10-08 00:00:13,068 INFO (colocate group clone checker|126) [ColocateTableCheckerAndBalancer.matchGroups():594] finished to check tablets. unhealth/total/added/in_sched/not_ready/exceed_limit: 0/0/0/0/0/0, cost: 0 ms
2026-10-08 00:00:13,775 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:13,775 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:14,775 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:14,775 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:15,776 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:15,776 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:16,631 INFO (thrift-server-pool-14|1358) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:16,631 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317861-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 0 ms.
2026-10-08 00:00:16,776 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:16,777 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:16,873 INFO (thrift-server-pool-12|810) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:16,873 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317937-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 0 ms.
2026-10-08 00:00:17,156 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():710] Collecting all dictionaries status for 0 dictionaries
2026-10-08 00:00:17,158 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():778] Collect 0 dictionaries status succeed
2026-10-08 00:00:17,777 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:17,777 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:18,062 INFO (report-thread|213) [ReportHandler.storagePolicyReport():399] backend[1788852317937] reports policies [], report resources: []
2026-10-08 00:00:18,062 INFO (thrift-server-pool-11|500) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: TABLET, report version 178885633740495, current queue size: 1
2026-10-08 00:00:18,062 INFO (report-thread|213) [ReportHandler.tabletReport():588] backend[1788852317937] reports 117 tablet(s). report version: 178885633740495
2026-10-08 00:00:18,062 INFO (report-thread|213) [LocalTabletInvertedIndex.logTabletReportSummary():481] finished to do tablet diff with backend[1788852317937]. fe tablet num: 117, backend tablet num: 117. sync: 0, metaDel: 0, foundInMeta: 117, migration: 0, backend partition num: 45, backend need update: 0, found invalid transactions 0(partitions: 0), found republish transactions 0(partitions: 0), tabletToUpdate: 0, need recovery: 0, cost: 0 ms
2026-10-08 00:00:18,062 INFO (report-thread|213) [ReportHandler.tabletReport():694] finished to handle tablet report from backend[1788852317937] cost: 0 ms
2026-10-08 00:00:18,777 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:18,777 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:19,491 INFO (thrift-server-pool-4|228) [ReportHandler.handleReport():240] receive report from be 1788852317975. type: DISK, report version -1, current queue size: 1
2026-10-08 00:00:19,491 INFO (report-thread|213) [ReportHandler.diskReport():772] begin to handle disk report from backend 1788852317975
2026-10-08 00:00:19,491 INFO (report-thread|213) [ReportHandler.diskReport():783] finished to handle disk report from backend: 1788852317975, disk size: 2, bad disk: [], cost: 0 ms
2026-10-08 00:00:19,491 INFO (report-thread|213) [ReportHandler.cpuReport():788] begin to handle cpu report from backend 1788852317975
2026-10-08 00:00:19,491 INFO (report-thread|213) [ReportHandler.cpuReport():802] finished to handle cpu report from backend 1788852317975, cost: 0 ms
2026-10-08 00:00:19,778 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:19,778 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:20,359 INFO (tablet checker|59) [TabletChecker.checkTablets():351] finished to check tablets. unhealth/total/added/in_sched/not_ready/exceed_limit: 0/117/0/0/0/0,cost: 1 ms
2026-10-08 00:00:20,779 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:20,779 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:21,426 INFO (thrift-server-pool-1|222) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: TABLET, report version 178885488840516, current queue size: 1
2026-10-08 00:00:21,426 INFO (report-thread|213) [ReportHandler.storagePolicyReport():399] backend[1788852317861] reports policies [], report resources: []
2026-10-08 00:00:21,427 INFO (report-thread|213) [ReportHandler.tabletReport():588] backend[1788852317861] reports 109 tablet(s). report version: 178885488840516
2026-10-08 00:00:21,427 INFO (report-thread|213) [LocalTabletInvertedIndex.logTabletReportSummary():481] finished to do tablet diff with backend[1788852317861]. fe tablet num: 109, backend tablet num: 109. sync: 0, metaDel: 0, foundInMeta: 109, migration: 0, backend partition num: 41, backend need update: 0, found invalid transactions 0(partitions: 0), found republish transactions 0(partitions: 0), tabletToUpdate: 0, need recovery: 0, cost: 0 ms
2026-10-08 00:00:21,427 INFO (report-thread|213) [ReportHandler.tabletReport():694] finished to handle tablet report from backend[1788852317861] cost: 0 ms
2026-10-08 00:00:21,779 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:21,779 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:21,834 INFO (thrift-server-pool-0|221) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:21,834 INFO (thrift-server-pool-2|223) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:22,158 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():710] Collecting all dictionaries status for 0 dictionaries
2026-10-08 00:00:22,159 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():778] Collect 0 dictionaries status succeed
2026-10-08 00:00:22,780 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:22,780 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:22,827 INFO (thrift-server-pool-13|811) [ReportHandler.handleReport():240] receive report from be 1788852317975. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:22,853 INFO (InsertOverwriteDropDirtyPartitions|95) [InsertOverwriteManager.runAfterCatalogReady():373] start clean insert overwrite temp partitions
2026-10-08 00:00:23,467 INFO (recycle bin|90) [CatalogRecycleBin.erasePartition():645] erasePartition eraseNum: 0 cost: 0ms
2026-10-08 00:00:23,467 INFO (recycle bin|90) [CatalogRecycleBin.eraseTable():508] eraseTable eraseNum: 0 cost: 0ms
2026-10-08 00:00:23,467 INFO (recycle bin|90) [CatalogRecycleBin.eraseDatabase():352] eraseDatabase eraseNum: 0 cost: 0ms
2026-10-08 00:00:23,780 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:23,781 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:24,781 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:24,781 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:24,942 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317975-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 0 ms.
2026-10-08 00:00:24,942 INFO (thrift-server-pool-3|227) [ReportHandler.handleReport():240] receive report from be 1788852317975. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:25,781 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:25,782 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:26,782 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:26,782 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:27,159 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():710] Collecting all dictionaries status for 0 dictionaries
2026-10-08 00:00:27,161 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():778] Collect 0 dictionaries status succeed
2026-10-08 00:00:27,593 INFO (binlog-gcer|75) [BinlogManager.gc():654] begin gc binlog
2026-10-08 00:00:27,593 INFO (binlog-gcer|75) [BinlogManager.gc():665] gc binlog, dbBinlogMap is null
2026-10-08 00:00:27,593 INFO (binlog-gcer|75) [BinlogGcer.runAfterCatalogReady():63] no gc binlog
2026-10-08 00:00:27,783 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:27,783 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:28,488 INFO (TopicPublisher|78) [TopicPublisherThread.runAfterCatalogReady():66] [topic_publish]begin publish topic info
2026-10-08 00:00:28,489 INFO (topic-publish-thread-0|214) [TopicPublisherThread$TopicPublishWorker.run():163] [topic_publish]publish topic info to be 10.xx.xx.xx success, time cost=1 ms, details: WORKLOAD_GROUP=1 WORKLOAD_SCHED_POLICY=0
2026-10-08 00:00:28,489 INFO (topic-publish-thread-2|216) [TopicPublisherThread$TopicPublishWorker.run():163] [topic_publish]publish topic info to be 10.xx.xx.xx success, time cost=1 ms, details: WORKLOAD_GROUP=1 WORKLOAD_SCHED_POLICY=0
2026-10-08 00:00:28,489 INFO (topic-publish-thread-1|215) [TopicPublisherThread$TopicPublishWorker.run():163] [topic_publish]publish topic info to be 10.xx.xx.xx success, time cost=1 ms, details: WORKLOAD_GROUP=1 WORKLOAD_SCHED_POLICY=0
2026-10-08 00:00:28,632 INFO (thrift-server-pool-14|1358) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:28,632 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317861-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 0 ms.
2026-10-08 00:00:28,783 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:28,784 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:29,784 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:29,784 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:30,785 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:30,785 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:30,874 INFO (thrift-server-pool-12|810) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:30,874 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317937-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 0 ms.
2026-10-08 00:00:31,785 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:31,785 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:31,834 INFO (thrift-server-pool-11|500) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:31,835 INFO (thrift-server-pool-1|222) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:32,161 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():710] Collecting all dictionaries status for 0 dictionaries
2026-10-08 00:00:32,162 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():778] Collect 0 dictionaries status succeed
2026-10-08 00:00:32,786 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:32,786 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:32,827 INFO (thrift-server-pool-4|228) [ReportHandler.handleReport():240] receive report from be 1788852317975. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:32,853 INFO (InsertOverwriteDropDirtyPartitions|95) [InsertOverwriteManager.runAfterCatalogReady():373] start clean insert overwrite temp partitions
2026-10-08 00:00:33,068 INFO (colocate group clone checker|126) [ColocateTableCheckerAndBalancer.matchGroups():594] finished to check tablets. unhealth/total/added/in_sched/not_ready/exceed_limit: 0/0/0/0/0/0, cost: 0 ms
2026-10-08 00:00:33,786 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:33,787 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:34,787 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:34,787 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:35,787 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:35,788 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:36,751 INFO (thrift-server-pool-2|223) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: DISK, report version -1, current queue size: 1
2026-10-08 00:00:36,751 INFO (report-thread|213) [ReportHandler.diskReport():772] begin to handle disk report from backend 1788852317861
2026-10-08 00:00:36,751 INFO (report-thread|213) [ReportHandler.diskReport():783] finished to handle disk report from backend: 1788852317861, disk size: 2, bad disk: [], cost: 0 ms
2026-10-08 00:00:36,751 INFO (report-thread|213) [ReportHandler.cpuReport():788] begin to handle cpu report from backend 1788852317861
2026-10-08 00:00:36,751 INFO (report-thread|213) [ReportHandler.cpuReport():802] finished to handle cpu report from backend 1788852317861, cost: 0 ms
2026-10-08 00:00:36,788 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:36,788 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:36,943 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317975-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 1 ms.
2026-10-08 00:00:36,943 INFO (thrift-server-pool-13|811) [ReportHandler.handleReport():240] receive report from be 1788852317975. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:37,162 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():710] Collecting all dictionaries status for 0 dictionaries
2026-10-08 00:00:37,164 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():778] Collect 0 dictionaries status succeed
2026-10-08 00:00:37,259 INFO (report-thread|213) [ReportHandler.diskReport():772] begin to handle disk report from backend 1788852317937
2026-10-08 00:00:37,259 INFO (thrift-server-pool-0|221) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: DISK, report version -1, current queue size: 1
2026-10-08 00:00:37,259 INFO (report-thread|213) [ReportHandler.diskReport():783] finished to handle disk report from backend: 1788852317937, disk size: 2, bad disk: [], cost: 0 ms
2026-10-08 00:00:37,259 INFO (report-thread|213) [ReportHandler.cpuReport():788] begin to handle cpu report from backend 1788852317937
2026-10-08 00:00:37,259 INFO (report-thread|213) [ReportHandler.cpuReport():802] finished to handle cpu report from backend 1788852317937, cost: 0 ms
2026-10-08 00:00:37,526 INFO (tablet stat mgr|42) [TabletStatMgr.runAfterCatalogReady():320] OlapTable num=9, partition num=45, tablet num=117, max tablet byte size=6082370(tablet_id=1789025260167), min tablet byte size=0(tablet_id=1789025260203), avg tablet byte size=420570, max partition byte size=23514740(partition_id=1789025260139), min partition byte size=0(partition_id=1789025260141), avg partition byte size=1093482, max table byte size=38728574(table_id=1789025259598), min table byte size=0(table_id=1788852319549), avg table byte size=5467414
2026-10-08 00:00:37,526 INFO (tablet stat mgr|42) [TabletStatMgr.runAfterCatalogReady():337] finished to update index row num of all databases. cost: 0 ms
2026-10-08 00:00:37,789 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:37,789 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:38,789 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:38,789 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:39,790 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:39,790 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:40,359 INFO (tablet checker|59) [TabletChecker.checkTablets():351] finished to check tablets. unhealth/total/added/in_sched/not_ready/exceed_limit: 0/117/0/0/0/0,cost: 0 ms
2026-10-08 00:00:40,633 INFO (thrift-server-pool-14|1358) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: TASK, report version -1, current queue size: 1
2026-10-08 00:00:40,633 INFO (report-thread|213) [ReportHandler.taskReport():762] finished to handle task report from backend 1788852317861-10.xx.xx.xx, diff task num: 0, publishTaskSize: 0, runningTasks: [], cost: 0 ms.
2026-10-08 00:00:40,791 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:40,791 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 1 ms
2026-10-08 00:00:41,791 INFO (tablet scheduler|58) [BeLoadRebalancer.selectAlternativeTabletsForCluster():116] get number of low load paths: 2, with medium: HDD, tag: {"location" : "default"}, isUrgent false
2026-10-08 00:00:41,791 INFO (tablet scheduler|58) [TabletScheduler.runAfterCatalogReady():366] finished to tablet scheduler. cost: 0 ms
2026-10-08 00:00:41,835 INFO (thrift-server-pool-12|810) [ReportHandler.handleReport():240] receive report from be 1788852317937. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:41,835 INFO (thrift-server-pool-1|222) [ReportHandler.handleReport():240] receive report from be 1788852317861. type: INDEX_POLICY, report version -1, current queue size: 1
2026-10-08 00:00:42,164 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():710] Collecting all dictionaries status for 0 dictionaries
2026-10-08 00:00:42,166 INFO (Dictionary Manager|96) [DictionaryManager.collectDictionaryStatus():778] Collect 0 dictionaries status succeed
doris_doris_roles.json
{"serviceName":"doris","roleVersion":3,"roleUpdateTime":"20260930-17:20:13.840-+0800"}
doris_doris_tag.json
{"op":"add_or_update","serviceName":"doris","tagVersion":10,"isDelta":false,"tagsChangeExtent":"ALL","isTagsDeduped":true}