[Bug] Doris 4.1.2 The write latency is 10x higher than before

[15767714253]

Search before asking

• I had searched in the issues and found no similar issues.

Version

4.1.2

What's Wrong?

2026-06-21 19:09:27.075 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:353,耗时:4232ms
2026-06-21 19:09:27.138 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数426
2026-06-21 19:09:29.020 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 422 | 状态: Success 耗时:637,提交总条数:422,成功条数:422
2026-06-21 19:09:29.169 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 415 | 状态: Success 耗时:142,提交总条数:415,成功条数:415
2026-06-21 19:09:29.316 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 415 | 状态: Success 耗时:139,提交总条数:415,成功条数:415
2026-06-21 19:09:29.508 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 415 | 状态: Success 耗时:187,提交总条数:415,成功条数:415
2026-06-21 19:09:29.912 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 398 | 状态: Success 耗时:370,提交总条数:398,成功条数:398
2026-06-21 19:09:30.278 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 632 | 状态: Success 耗时:357,提交总条数:632,成功条数:632
2026-06-21 19:09:30.432 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 632 | 状态: Success 耗时:148,提交总条数:632,成功条数:632
2026-06-21 19:09:30.573 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | ��: device_bms_group_realtime | 条数: 91 | 状态: Success 耗时:136,提交总条数:91,成功条数:91
2026-06-21 19:09:30.701 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 91 | 状态: Success 耗时:123,提交总条数:91,成功条数:91
2026-06-21 19:09:30.818 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 2 | 状态: Success 耗时:112,提交总条数:2,成功条数:2
2026-06-21 19:09:31.018 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 2 | 状态: Success 耗时:148,提交总条���:2,成功条数:2
2026-06-21 19:09:31.137 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 2 | 状态: Success 耗时:115,提交总条数:2,成功条数:2
2026-06-21 19:09:31.263 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 2 | 状态: Success 耗时:122,提交总条数:2,成功条数:2
2026-06-21 19:09:31.263 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:422,耗时:3271ms
2026-06-21 19:09:31.604 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数201
2026-06-21 19:09:32.775 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 200 | 状态: Success 耗时:612,提交总条数:200,成功条数:200
2026-06-21 19:09:33.000 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 199 | 状态: Success 耗时:220,提交总条数:199,成功条数:199
2026-06-21 19:09:33.203 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条��: 199 | 状态: Success 耗时:198,提交总条数:199,成功条数:199
2026-06-21 19:09:33.406 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 199 | 状态: Success 耗时:197,提交总条数:199,成功条数:199
2026-06-21 19:09:33.750 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 191 | 状态: Success 耗时:330,提交总条数:191,成功条数:191
2026-06-21 19:09:34.196 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 365 | 状态: Success 耗时:440,提交总条数:365,成功条数:365
2026-06-21 19:09:34.353 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 365 | 状态: Success 耗时:153,提交总条数:365,成功条数:365
2026-06-21 19:09:34.492 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 50 | 状态: Success 耗时:135,提交总条数:50,成功条数:50
2026-06-21 19:09:34.615 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 50 | 状态: Success 耗时:119,提交总条数:50,成功条数:50
2026-06-21 19:09:34.615 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:200,耗时:2685ms
2026-06-21 19:09:34.651 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数359
2026-06-21 19:09:36.251 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 358 | 状态: Success 耗时:522,提交总条数:358,成功条数:358
2026-06-21 19:09:36.428 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 347 | 状态: Success 耗时:170,提交总条数:347,成功条数:347
2026-06-21 19:09:36.625 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 347 | 状态: Success 耗时:190,提交总条数:347,成功条数:347
2026-06-21 19:09:36.768 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 347 | 状态: Success 耗时:135,提交总条数:347,成功条数:347
2026-06-21 19:09:37.108 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 339 | 状态: Success 耗时:309,提交总条数:339,成功条数:339
2026-06-21 19:09:37.752 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 669 | 状态: Success 耗时:488,提交总条数:669,成功条数:669
2026-06-21 19:09:38.004 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 669 | 状态: Success 耗时:179,提交总条数:669,成功条数:669
2026-06-21 19:09:38.143 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 92 | 状态: Success 耗时:134,提交总条数:92,成功条数:92
2026-06-21 19:09:38.284 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 92 | 状态: Success 耗时:137,提交总条数:92,成功条数:92
2026-06-21 19:09:39.305 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 1 | 状态: Success 耗时:258,提交总条数:1,成功条数:1
2026-06-21 19:09:39.851 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 1 | 状态: Success 耗时:503,提交总条数:1,成功条数:1
2026-06-21 19:09:39.961 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 1 | 状态: Success 耗时:105,提交总条数:1,成功条数:1
2026-06-21 19:09:40.081 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 1 | 状态: Success 耗时:116,提交总条数:1,成功条数:1
2026-06-21 19:09:40.081 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:358,耗时:4691ms
2026-06-21 19:09:40.162 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数420
2026-06-21 19:09:42.410 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 419 | 状态: Success 耗时:1068,提交总条数:419,成功条数:419
2026-06-21 19:09:42.735 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 413 | 状态: Success 耗时:319,提交总条数:413,成功条数:413
2026-06-21 19:09:43.049 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 413 | 状态: Success 耗时:142,提交总条数:413,成功条数:413
2026-06-21 19:09:43.197 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 413 | 状态: Success 耗时:141,提交总条数:413,成功条数:413
2026-06-21 19:09:43.569 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 401 | 状态: Success 耗时:337,提交总条数:401,成功条数:401
2026-06-21 19:09:44.002 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 757 | 状态: Success 耗时:424,提交总条数:757,成功条数:757
2026-06-21 19:09:44.185 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 757 | 状态: Success 耗时:177,提交总条数:757,成功条数:757
2026-06-21 19:09:44.407 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 110 | 状态: Success 耗时:217,提交总条数:110,成功条数:110
2026-06-21 19:09:44.550 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 110 | 状态: Success 耗时:135,提交总条数:110,成功条数:110
2026-06-21 19:09:44.688 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_realtime | 条数: 3 | 状态: Success 耗时:134,提���总条数:3,成功条数:3
2026-06-21 19:09:44.809 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_hot | 条数: 3 | 状态: Success 耗时:119,提交总条数:3,成功条数:3
2026-06-21 19:09:44.982 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 1 | 状态: Success 耗时:116,提交总条数:1,成功条数:1
2026-06-21 19:09:45.109 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 1 | 状态: Success 耗时:122,提交总条数:1,成功条数:1
2026-06-21 19:09:45.226 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 1 | 状态: Success 耗时:113,提交总条数:1,成功条数:1
2026-06-21 19:09:45.343 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 1 | 状态: Success 耗时:113,提交总条数:1,成功条数:1
2026-06-21 19:09:45.343 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:419,耗时:4414ms
2026-06-21 19:09:45.367 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数231
2026-06-21 19:09:46.456 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 231 | 状态: Success 耗时:444,提交总条数:231,成功条数:231
2026-06-21 19:09:46.618 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 229 | 状态: Success 耗时:156,提交总条数:229,成功条数:229
2026-06-21 19:09:46.758 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 229 | 状态: Success 耗时:135,提交总条数:229,成功条数:229
2026-06-21 19:09:46.906 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 229 | 状态: Success 耗时:141,提交总条数:229,成功条数:229
2026-06-21 19:09:47.235 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 223 | 状态: Success 耗时:307,提交总条数:223,成功条数:223
2026-06-21 19:09:47.637 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 400 | 状态: Success 耗时:396,提交总条数:400,成功条数:400
2026-06-21 19:09:48.761 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 400 | 状态: Success 耗时:139,提交总条数:400,成功条数:400
2026-06-21 19:09:48.906 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 66 | 状态: Success 耗时:141,提交总条数:66,成功条数:66
2026-06-21 19:09:49.031 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 66 | 状态: Success 耗时:121,提交总条数:66,成功条数:66
2026-06-21 19:09:49.160 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_realtime | 条数: 1 | 状态: Success 耗时:125,提交总条数:1,成功条数:1
2026-06-21 19:09:49.277 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_hot | 条数: 1 | 状态: Success 耗时:113,提交总条数:1,成功条数:1
2026-06-21 19:09:49.277 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:231,耗时:3486ms
2026-06-21 19:09:49.315 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数465
2026-06-21 19:09:51.346 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 463 | 状态: Success 耗时:639,提交总条数:463,成功条数:463
2026-06-21 19:09:51.501 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 456 | 状态: Success 耗时:149,提交总条数:456,成功条数:456
2026-06-21 19:09:51.668 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 456 | 状态: Success 耗时:160,提交总条数:456,成功条数:456
2026-06-21 19:09:51.867 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 456 | 状态: Success 耗时:192,提交总条数:456,成功条数:456
2026-06-21 19:09:52.296 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 444 | 状态: Success 耗时:388,提交总条数:444,成功条数:444
2026-06-21 19:09:52.747 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 856 | 状态: Success 耗时:420,提交总条数:856,成功条数:856
2026-06-21 19:09:52.968 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 856 | 状态: Success 耗时:217,提交总条数:856,成功条数:856
2026-06-21 19:09:53.105 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 148 | 状态: Success 耗时:131,提交总条数:148,成功条数:148
2026-06-21 19:09:53.255 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 148 | 状态: Success 耗时:146,提交总条数:148,成功条数:148
2026-06-21 19:09:53.380 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_realtime | 条数: 1 | 状态: Success 耗时:121,提交总条数:1,成功条数:1
2026-06-21 19:09:53.490 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_hot | 条数: 1 | 状态: Success 耗时:106,提交总条数:1,成功条数:1
2026-06-21 19:09:53.611 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 3 | 状态: Success 耗时:116,提交总条数:3,成功条数:3
2026-06-21 19:09:53.783 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 3 | 状态: Success 耗时:101,提交总条数:3,成功条数:3
2026-06-21 19:09:53.935 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 3 | 状态: Success 耗时:148,提交总条数:3,成功条数:3
2026-06-21 19:09:54.059 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 3 | 状态: Success 耗时:121,提交总条数:3,成功条数:3
2026-06-21 19:09:54.059 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:463,耗时:3817ms
2026-06-21 19:09:54.149 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数658
2026-06-21 19:09:58.429 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 657 | 状态: Success 耗时:815,提交总条数:657,成功条数:657
2026-06-21 19:09:58.584 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 654 | 状态: Success 耗时:147,提交总条数:654,成功条数:654
2026-06-21 19:09:58.727 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 654 | 状态: Success 耗时:137,提交总条数:654,成功条数:654
2026-06-21 19:09:58.883 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 654 | 状态: Success 耗时:149,提交总条数:654,成功条数:654
2026-06-21 19:09:59.310 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 643 | 状态: Success 耗时:369,提交总条数:643,成功条数:643
2026-06-21 19:09:59.750 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 1128 | 状态: Success 耗时:429,提交总条数:1128,成功条数:1128
2026-06-21 19:09:59.925 [org.springframework.kafka.KafkaListenerEndpointContainer#50-0-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 1128 | 状态: Success 耗时:169,提交总条数:1128,成功条数:1128

That is before upgrade

This is after upgrade

2026-06-22 19:22:17.150 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数896
2026-06-22 19:22:23.087 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 895 | 状态: Success 耗时:2196,提交总条数:895,成功条数:895
2026-06-22 19:22:24.283 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 892 | 状态: Success 耗时:658,提交总条数:892,成功条数:892
2026-06-22 19:22:25.309 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 892 | 状态: Success 耗时:799,提交总条数:892,成功条数:892
2026-06-22 19:22:25.810 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 892 | 状态: Success 耗时:483,提交总条数:892,成功条数:892
2026-06-22 19:22:27.516 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 880 | 状态: Success 耗时:1649,提交总条数:880,成功条数:880
2026-06-22 19:22:28.772 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 2621 | 状态: Success 耗时:1068,提交总条数:2621,成功条数:2621
2026-06-22 19:22:29.592 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 2621 | 状态: Success 耗时:814,提交总条数:2621,成功条数:2621
2026-06-22 19:22:30.697 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 500 | 状态: Success 耗时:1098,提交总条数:500,成功条数:500
2026-06-22 19:22:31.571 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 500 | 状态: Success 耗时:871,提交总条数:500,成功条数:500
2026-06-22 19:22:32.424 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_realtime | 条数: 4 | 状态: Success 耗时:502,提交总条数:4,成功条数:4
2026-06-22 19:22:33.755 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_hot | 条数: 4 | 状态: Success 耗时:1328,提交总条数:4,成功条数:4
2026-06-22 19:22:34.722 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 20 | 状态: Success 耗时:963,提交总条数:20,成功条数:20
2026-06-22 19:22:36.381 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 20 | 状态: Success 耗时:757,提交总条数:20,成功条数:20
2026-06-22 19:22:38.487 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 20 | 状态: Success 耗时:1241,提交总条数:20,成功条数:20
2026-06-22 19:22:39.432 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 20 | 状态: Success 耗时:941,提交总条数:20,成功条数:20
2026-06-22 19:22:39.433 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:895,耗时:19721ms
2026-06-22 19:22:39.434 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - listenInverterStoreRealData消费数据条数896耗时22284ms
2026-06-22 19:22:39.475 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数960
2026-06-22 19:22:46.902 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 959 | 状态: Success 耗时:3584,提交总条数:959,成功条数:959
2026-06-22 19:22:48.584 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 948 | 状态: Success 耗时:842,提交总条数:948,成功条数:948
2026-06-22 19:22:49.378 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 948 | 状态: Success 耗时:784,提交总条数:948,成功条数:948
2026-06-22 19:22:50.479 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 948 | 状态: Success 耗时:1094,提交总条数:948,成功条数:948
2026-06-22 19:22:51.697 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 930 | 状态: Success 耗时:1161,提交总条数:930,成功条数:930
2026-06-22 19:22:53.022 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 2594 | 状态: Success 耗时:647,提交总条数:2594,成功条数:2594
2026-06-22 19:22:53.834 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 2594 | 状态: Success 耗时:805,提交总条数:2594,成功条数:2594
2026-06-22 19:22:54.617 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 383 | 状态: Success 耗时:777,提交总条数:383,成功条数:383
2026-06-22 19:22:55.349 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 383 | 状态: Success 耗时:727,提交总条数:383,成功条数:383
2026-06-22 19:22:56.168 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 29 | 状态: Success 耗时:815,提交总条数:29,成功条数:29
2026-06-22 19:22:56.923 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 29 | 状态: Success 耗时:750,提交总条数:29,成功条数:29
2026-06-22 19:22:57.375 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 29 | 状态: Success 耗时:406,提交总条数:29,成功条数:29
2026-06-22 19:22:58.660 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 29 | 状态: Success 耗时:756,提交总条数:29,成功条数:29
2026-06-22 19:22:58.660 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:959,耗时:17366ms
2026-06-22 19:22:58.661 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - listenInverterStoreRealData消费数据条数960耗时19186ms
2026-06-22 19:22:58.701 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数944
2026-06-22 19:23:08.161 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 941 | 状态: Success 耗时:6214,提交总条数:941,成功条数:941
2026-06-22 19:23:08.984 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 932 | 状态: Success 耗时:814,提交总条数:932,成功条数:932
2026-06-22 19:23:09.565 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 932 | 状态: Success 耗时:573,提交总条数:932,成功条数:932
2026-06-22 19:23:10.531 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 932 | 状态: Success 耗时:958,提交总条数:932,成功条数:932
2026-06-22 19:23:11.858 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 917 | 状态: Success 耗时:1270,提交总条数:917,成功条数:917
2026-06-22 19:23:12.712 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 2733 | 状态: Success 耗时:833,提交总条数:2733,成功条数:2733
2026-06-22 19:23:13.488 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 2733 | 状态: Success 耗时:771,提交总条数:2733,成功条数:2733
2026-06-22 19:23:14.151 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 387 | 状态: Success 耗时:658,提交总条数:387,成功条数:387
2026-06-22 19:23:14.854 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 387 | 状态: Success 耗时:699,提交总条数:387,成功条数:387
2026-06-22 19:23:15.768 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_realtime | 条数: 2 | 状态: Success 耗时:910,提交总条数:2,成功条数:2
2026-06-22 19:23:16.787 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_hot | 条数: 2 | 状态: Success 耗时:803,提交总条数:2,成功条数:2
2026-06-22 19:23:17.911 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 28 | 状态: Success 耗时:1120,提交总条数:28,成功条数:28
2026-06-22 19:23:19.198 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 28 | 状态: Success 耗时:1282,提交总条数:28,成功条数:28
2026-06-22 19:23:19.981 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条数: 28 | 状态: Success 耗时:779,提交总条数:28,成功条数:28
2026-06-22 19:23:22.057 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 28 | 状态: Success 耗时:759,提交总条数:28,成功条数:28
2026-06-22 19:23:22.057 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:941,耗时:21335ms
2026-06-22 19:23:22.058 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - listenInverterStoreRealData消费数据条数944耗时23357ms
2026-06-22 19:23:22.102 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数1095
2026-06-22 19:23:28.238 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_realtime | 条数: 1091 | 状态: Success 耗时:3161,提交总条数:1091,成功条数:1091
2026-06-22 19:23:28.998 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_day | 条数: 1070 | 状态: Success 耗时:752,提交总条数:1070,成功条数:1070
2026-06-22 19:23:29.704 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_month | 条数: 1070 | 状态: Success 耗时:696,提交总条数:1070,成功条数:1070
2026-06-22 19:23:30.737 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_year | 条数: 1070 | 状态: Success 耗时:1026,提交总条数:1070,成功条数:1070
2026-06-22 19:23:32.163 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_inv_hot | 条数: 1043 | 状态: Success 耗时:1364,提交总条数:1043,成功条数:1043
2026-06-22 19:23:34.151 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_realtime | 条数: 1933 | 状态: Success 耗时:882,提交总条数:1933,成功条数:1933
2026-06-22 19:23:35.218 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_cluster_hot | 条数: 1933 | 状态: Success 耗时:1053,提交总条数:1933,成功条数:1933
2026-06-22 19:23:35.882 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_realtime | 条数: 259 | 状态: Success 耗时:660,提交总条数:259,成功条数:259
2026-06-22 19:23:36.485 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_bms_group_hot | 条数: 259 | 状态: Success 耗时:599,提交总条数:259,成功条数:259
2026-06-22 19:23:37.467 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_realtime | 条数: 1 | 状态: Success 耗时:620,提交总条数:1,成功条数:1
2026-06-22 19:23:38.131 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ev_charger_hot | 条数: 1 | 状态: Success 耗时:528,提交总条数:1,成功条数:1
2026-06-22 19:23:39.001 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_realtime | 条数: 22 | 状态: Success 耗时:867,提交总条数:22,成功条数:22
2026-06-22 19:23:39.978 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_collect_hot | 条数: 22 | 状态: Success 耗时:973,提交总条数:22,成功条数:22
2026-06-22 19:23:41.265 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_realtime | 条��: 22 | 状态: Success 耗时:1283,提交总条数:22,成功条数:22
2026-06-22 19:23:42.721 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.DorisStreamLoadService - Doris Stream Load成功 | 库: iot | 表: device_ems_inv_control_hot | 条数: 22 | 状态: Success 耗时:740,提交总条数:22,成功条数:22
2026-06-22 19:23:42.722 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.service.gen5.Gen5MqttStoreRealtimeService - 储能逆变器实时数据==》》大表、日月年表批次upsert Doris耗时记录，批次数:1091,耗时:18776ms
2026-06-22 19:23:42.723 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - listenInverterStoreRealData消费数据条数1095耗时20621ms
2026-06-22 19:23:42.769 [org.springframework.kafka.KafkaListenerEndpointContainer#2-1-C-1] com.saj.big.table.consume.listener.gen5.doris.Gen5RealTimeDorisKafkaListener - 【Doris listenInverterStoreRealData】拉取数据条数1105

What You Expected?

why? It's truly unbelievable

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[zclllyybb]

Breakwater-GitHub-Analysis-Slot: slot_6612ad2e0ca8
This content is generated by AI for reference only.

Initial triage:

I cannot confirm a specific Doris 4.1.2 root cause from the pasted application logs alone.

The before/after samples are not the same workload shape. In the "before upgrade" section, the shown listener batches are roughly 200-658 source rows and each serialized application cycle is mostly about 2.7-4.7s. In the "after upgrade" section, the shown listener batches are about 895-1095 source rows, and some derived Stream Load calls reach about 1.9k-2.7k rows. Since the application appears to send many Stream Load requests sequentially on one Kafka listener thread, part of the end-to-end increase can come from larger batches plus serialized per-table loads.

That said, the evidence is still suspicious for a shared Doris-side bottleneck or environment bottleneck, not just row count. After upgrade, even very small loads such as 1-29 rows often take about 500-1300ms, and device_inv_realtime reaches 2.2s, 3.6s, and 6.2s in the pasted samples. That pattern would be consistent with transaction publish delay, backend write/resource pressure, compaction/tablet-version pressure, network/request-body delay, or client-side queuing, but the current logs do not identify which one.

Code-side anchor for maintainers: in Doris 4.1.2, the Stream Load BE response and BE INFO log split the latency into LoadTimeMs, BeginTxnTimeMs, StreamLoadPutTimeMs, ReceiveDataTimeMs, ReadDataTimeMs, WriteDataTimeMs, and CommitAndPublishTimeMs (be/src/load/stream_load/stream_load_context.cpp, plus the finished to execute stream load log in be/src/service/http/action/stream_load.cpp). Those fields are the key evidence needed here:

• If CommitAndPublishTimeMs is high, focus on FE transaction publish, tablet version count, compaction backlog, or master FE pressure.
• If WriteDataTimeMs is high, focus on BE ingestion/storage/write path, schema/index cost, payload size, and resource pressure.
• If ReceiveDataTimeMs or the gap between client time and LoadTimeMs is high, focus on client serialization, HTTP request upload, redirect/network path, or the single Kafka listener thread.
• If LoadTimeMs is low while the application "Doris Stream Load" duration is high, the bottleneck is likely outside the Doris Stream Load execution itself.

Information needed to make this actionable:

1. The exact previous Doris version and whether any table schema, replica count, bucket count, BE/FE count, hardware, network path, or Stream Load client settings changed during the upgrade.
2. Full Stream Load JSON responses before and after upgrade for the same table and comparable payload size, including the timing fields above and the request label.
3. Matching BE logs around finished to execute stream load. label=... and FE master logs around begin/commit/publish for several slow labels.
4. DDL for the affected tables, especially whether they are Unique Key/MOW tables, whether partial update or sequence columns are used, indexes, partitions, buckets, and replication settings.
5. Stream Load request headers, especially group_commit, two_phase_commit, merge_type, columns, partial_columns, and format settings.
6. Cluster state during the slow window: SHOW BACKENDS, CPU/IO/network utilization, compaction backlog, tablet version count or tablet health output, and whether other loads/queries were running.
7. A minimal repro or a controlled comparison that sends the same payload to the same table before and after upgrade, preferably with the full server-side Stream Load timing fields.

Next suggested maintainer step: ask for the full Stream Load JSON responses and the matching BE/FE logs first. Without those timing fields, this issue should remain open as a possible write-latency regression, but the current public evidence is insufficient to assign it to a concrete Doris 4.1.2 code bug.

[sollhui]

Thank you for your feedback. Could you please describe it more clearly, such as the import method, parameters, and other usage details?

[MoanasDaddyXu]

What was the previous version, and what is the current version?

[gavinchou]

The key evidence is still missing here. To determine whether this is a Doris 4.1.2 regression or an environment/workload/client-side effect, we need a controlled comparison using the same payload size, same target table, and the same Stream Load parameters before and after the upgrade.

Please provide the full Stream Load JSON responses for several slow labels, especially the timing fields such as LoadTimeMs, BeginTxnTimeMs, StreamLoadPutTimeMs, ReceiveDataTimeMs, ReadDataTimeMs, WriteDataTimeMs, and CommitAndPublishTimeMs. Matching BE logs for finished to execute stream load and FE logs around begin/commit/publish for those labels would also be very helpful.

From the pasted application logs alone, the after-upgrade batches are much larger than the before-upgrade batches, so the current evidence does not by itself prove a 10x Doris write regression. It does show higher observed latency, especially for small Stream Load requests, but the server-side timing fields are needed to locate where the extra time is spent.