[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from ConsensusPeerHealthStatusITest
[ RUN      ] ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:03:21.740360 21220 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:03:21.740510 21220 ts_itest-base.cc:116] --------------
I20260812 08:03:21.740522 21220 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:03:21.740535 21220 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:03:21.740546 21220 ts_itest-base.cc:119] --------------
2026-08-12T08:03:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:21Z Disabled control of system clock
I20260812 08:03:21.752310 21220 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
/tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.185.62:40533
--webserver_interface=127.20.185.62
--webserver_port=0
--builtin_ntp_servers=127.20.185.20:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.185.62:40533
--master_add_server_when_underreplicated=false
--catalog_manager_evict_excess_replicas=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:03:21.876782 21248 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:21.877108 21248 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:21.877189 21248 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:21.882181 21248 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:21.882306 21248 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:21.882341 21248 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:21.882360 21248 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:21.886339 21248 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.185.20:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_evict_excess_replicas=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.20.185.62:40533
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.185.62:40533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.20.185.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:21.887445 21248 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:21.888631 21248 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:21.894533 21262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:21.894537 21258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:21.894560 21259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:21.894879 21248 server_base.cc:1061] running on GCE node
I20260812 08:03:21.895406 21248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:21.896342 21248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:21.897493 21248 hybrid_clock.cc:648] HybridClock initialized: now 1786521801897439 us; error 67 us; skew 500 ppm
I20260812 08:03:21.899447 21248 webserver.cc:533] Webserver started at http://127.20.185.62:40991/ using document root <none> and password file <none>
I20260812 08:03:21.900053 21248 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:21.900110 21248 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:21.900367 21248 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:21.902047 21248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "ee6bd82bec6e421ca3931b7112092d74"
format_stamp: "Formatted at 2026-08-12 08:03:21 on dist-test-slave-zh2d"
I20260812 08:03:21.902561 21248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "ee6bd82bec6e421ca3931b7112092d74"
format_stamp: "Formatted at 2026-08-12 08:03:21 on dist-test-slave-zh2d"
I20260812 08:03:21.906020 21248 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:03:21.908327 21274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:21.909718 21248 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:21.909881 21248 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal
uuid: "ee6bd82bec6e421ca3931b7112092d74"
format_stamp: "Formatted at 2026-08-12 08:03:21 on dist-test-slave-zh2d"
I20260812 08:03:21.910003 21248 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:21.924988 21248 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:21.925753 21248 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:21.925974 21248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:21.935236 21248 rpc_server.cc:307] RPC server started. Bound to: 127.20.185.62:40533
I20260812 08:03:21.935276 21365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.185.62:40533 every 8 connection(s)
I20260812 08:03:21.936424 21248 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:03:21.938531 21220 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu as pid 21248
I20260812 08:03:21.938747 21220 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:03:21.939714 21367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:21.945859 21367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74: Bootstrap starting.
I20260812 08:03:21.948547 21367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:21.949450 21367 log.cc:826] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:21.951490 21367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74: No bootstrap required, opened a new log
I20260812 08:03:21.954110 21367 raft_consensus.cc:359] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6bd82bec6e421ca3931b7112092d74" member_type: VOTER last_known_addr { host: "127.20.185.62" port: 40533 } }
I20260812 08:03:21.954294 21367 raft_consensus.cc:385] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:21.954330 21367 raft_consensus.cc:740] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6bd82bec6e421ca3931b7112092d74, State: Initialized, Role: FOLLOWER
I20260812 08:03:21.954751 21367 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6bd82bec6e421ca3931b7112092d74" member_type: VOTER last_known_addr { host: "127.20.185.62" port: 40533 } }
I20260812 08:03:21.954871 21367 raft_consensus.cc:399] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:03:21.954910 21367 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:03:21.954998 21367 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:21.955971 21367 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6bd82bec6e421ca3931b7112092d74" member_type: VOTER last_known_addr { host: "127.20.185.62" port: 40533 } }
I20260812 08:03:21.956365 21367 leader_election.cc:304] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6bd82bec6e421ca3931b7112092d74; no voters: 
I20260812 08:03:21.956782 21367 leader_election.cc:290] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:03:21.956877 21374 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:21.957194 21374 raft_consensus.cc:697] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [term 1 LEADER]: Becoming Leader. State: Replica: ee6bd82bec6e421ca3931b7112092d74, State: Running, Role: LEADER
I20260812 08:03:21.958213 21367 sys_catalog.cc:565] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:21.958231 21374 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6bd82bec6e421ca3931b7112092d74" member_type: VOTER last_known_addr { host: "127.20.185.62" port: 40533 } }
I20260812 08:03:21.959893 21375 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee6bd82bec6e421ca3931b7112092d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6bd82bec6e421ca3931b7112092d74" member_type: VOTER last_known_addr { host: "127.20.185.62" port: 40533 } } }
I20260812 08:03:21.960016 21375 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:21.960503 21377 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6bd82bec6e421ca3931b7112092d74. Latest consensus state: current_term: 1 leader_uuid: "ee6bd82bec6e421ca3931b7112092d74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6bd82bec6e421ca3931b7112092d74" member_type: VOTER last_known_addr { host: "127.20.185.62" port: 40533 } } }
I20260812 08:03:21.960583 21377 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74 [sys.catalog]: This master's current role is: LEADER
W20260812 08:03:21.963511 21396 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:21.963647 21396 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:21.963744 21388 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:21.964514 21388 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:21.970023 21388 catalog_manager.cc:1383] Generated new cluster ID: fbbda272149b42c1965182a71073e616
I20260812 08:03:21.970098 21388 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:21.983006 21388 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:21.983987 21388 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:22.000365 21388 catalog_manager.cc:6092] T 00000000000000000000000000000000 P ee6bd82bec6e421ca3931b7112092d74: Generated new TSK 0
I20260812 08:03:22.001142 21388 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:22.007009 21220 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
/tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.185.1:0
--local_ip_for_outbound_sockets=127.20.185.1
--webserver_interface=127.20.185.1
--webserver_port=0
--tserver_master_addrs=127.20.185.62:40533
--builtin_ntp_servers=127.20.185.20:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20260812 08:03:22.123127 21400 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:03:22.123356 21400 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:03:22.123389 21400 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:22.123437 21400 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:22.123543 21400 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:22.127794 21400 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:03:22.127871 21400 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:03:22.127908 21400 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:22.128052 21400 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:03:22.128094 21400 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.185.1
I20260812 08:03:22.132014 21400 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.185.20:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.185.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.20.185.1
--webserver_port=0
--tserver_master_addrs=127.20.185.62:40533
--never_fsync=true
--heap_profile_path=/tmp/kudu.21400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.185.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:22.133538 21400 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:22.134753 21400 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:22.141597 21414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:22.141597 21412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:22.141610 21411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:22.142021 21400 server_base.cc:1061] running on GCE node
I20260812 08:03:22.142400 21400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:22.142905 21400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:22.144066 21400 hybrid_clock.cc:648] HybridClock initialized: now 1786521802144048 us; error 29 us; skew 500 ppm
I20260812 08:03:22.145963 21400 webserver.cc:533] Webserver started at http://127.20.185.1:34425/ using document root <none> and password file <none>
I20260812 08:03:22.146528 21400 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:22.146580 21400 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:22.146739 21400 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:22.148308 21400 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "40b72fcd879c485ebe1764d8d3626337"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.148810 21400 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "40b72fcd879c485ebe1764d8d3626337"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.152132 21400 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:22.154345 21423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.155344 21400 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:22.155467 21400 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "40b72fcd879c485ebe1764d8d3626337"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.155562 21400 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:22.199703 21400 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:22.200480 21400 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:22.200695 21400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:22.201377 21400 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:22.202458 21400 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:22.202505 21400 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.202575 21400 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:22.202627 21400 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.212284 21400 rpc_server.cc:307] RPC server started. Bound to: 127.20.185.1:45467
I20260812 08:03:22.212306 21624 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.185.1:45467 every 8 connection(s)
I20260812 08:03:22.213325 21400 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:03:22.214485 21220 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu as pid 21400
I20260812 08:03:22.214623 21220 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:03:22.218477 21220 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
/tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.185.2:0
--local_ip_for_outbound_sockets=127.20.185.2
--webserver_interface=127.20.185.2
--webserver_port=0
--tserver_master_addrs=127.20.185.62:40533
--builtin_ntp_servers=127.20.185.20:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260812 08:03:22.224094 21626 heartbeater.cc:344] Connected to a master server at 127.20.185.62:40533
I20260812 08:03:22.224383 21626 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:22.224968 21626 heartbeater.cc:507] Master 127.20.185.62:40533 requested a full tablet report, sending...
I20260812 08:03:22.226753 21298 ts_manager.cc:194] Registered new tserver with Master: 40b72fcd879c485ebe1764d8d3626337 (127.20.185.1:45467)
I20260812 08:03:22.228540 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.185.1:44767
W20260812 08:03:22.333251 21630 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:03:22.333494 21630 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:03:22.333526 21630 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:22.333545 21630 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:22.333585 21630 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:22.336771 21630 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:03:22.336817 21630 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:03:22.336879 21630 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:22.336936 21630 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:03:22.336964 21630 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.185.2
I20260812 08:03:22.340858 21630 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.185.20:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.185.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.20.185.2
--webserver_port=0
--tserver_master_addrs=127.20.185.62:40533
--never_fsync=true
--heap_profile_path=/tmp/kudu.21630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.185.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:22.341876 21630 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:22.343091 21630 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:22.349877 21646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:22.349792 21651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:22.350085 21630 server_base.cc:1061] running on GCE node
W20260812 08:03:22.349803 21645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:22.350543 21630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:22.351109 21630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:22.352284 21630 hybrid_clock.cc:648] HybridClock initialized: now 1786521802352253 us; error 42 us; skew 500 ppm
I20260812 08:03:22.354110 21630 webserver.cc:533] Webserver started at http://127.20.185.2:33309/ using document root <none> and password file <none>
I20260812 08:03:22.354732 21630 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:22.354789 21630 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:22.355018 21630 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:22.356565 21630 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "84d798fc1ce844e98105b3a3a1ac665a"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.357084 21630 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "84d798fc1ce844e98105b3a3a1ac665a"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.360710 21630 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:03:22.362901 21659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.363935 21630 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:22.364055 21630 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "84d798fc1ce844e98105b3a3a1ac665a"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.364151 21630 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:22.381507 21630 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:22.382114 21630 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:22.382306 21630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:22.382891 21630 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:22.383894 21630 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:22.383944 21630 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.384012 21630 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:22.384052 21630 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.393321 21630 rpc_server.cc:307] RPC server started. Bound to: 127.20.185.2:43331
I20260812 08:03:22.393401 21869 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.185.2:43331 every 8 connection(s)
I20260812 08:03:22.394364 21630 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:03:22.394961 21220 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu as pid 21630
I20260812 08:03:22.395089 21220 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:03:22.397876 21220 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
/tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.185.3:0
--local_ip_for_outbound_sockets=127.20.185.3
--webserver_interface=127.20.185.3
--webserver_port=0
--tserver_master_addrs=127.20.185.62:40533
--builtin_ntp_servers=127.20.185.20:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260812 08:03:22.405489 21870 heartbeater.cc:344] Connected to a master server at 127.20.185.62:40533
I20260812 08:03:22.405787 21870 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:22.406497 21870 heartbeater.cc:507] Master 127.20.185.62:40533 requested a full tablet report, sending...
I20260812 08:03:22.407727 21298 ts_manager.cc:194] Registered new tserver with Master: 84d798fc1ce844e98105b3a3a1ac665a (127.20.185.2:43331)
I20260812 08:03:22.408325 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.185.2:34503
W20260812 08:03:22.514119 21873 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:03:22.514353 21873 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:03:22.514452 21873 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:22.514497 21873 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:22.514590 21873 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:22.517997 21873 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:03:22.518049 21873 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:03:22.518087 21873 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:22.518229 21873 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:03:22.518262 21873 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.185.3
I20260812 08:03:22.522132 21873 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.185.20:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.185.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.20.185.3
--webserver_port=0
--tserver_master_addrs=127.20.185.62:40533
--never_fsync=true
--heap_profile_path=/tmp/kudu.21873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.185.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:22.523216 21873 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:22.524402 21873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:22.531387 21889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:22.531401 21884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:22.531401 21885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:22.531658 21873 server_base.cc:1061] running on GCE node
I20260812 08:03:22.532012 21873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:22.532569 21873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:22.533726 21873 hybrid_clock.cc:648] HybridClock initialized: now 1786521802533685 us; error 50 us; skew 500 ppm
I20260812 08:03:22.535542 21873 webserver.cc:533] Webserver started at http://127.20.185.3:39699/ using document root <none> and password file <none>
I20260812 08:03:22.536157 21873 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:22.536216 21873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:22.536466 21873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:22.538157 21873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "0259c34184cd4ff59e80b9a8899d75fb"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.538779 21873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "0259c34184cd4ff59e80b9a8899d75fb"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.542426 21873 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:22.544684 21900 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.545737 21873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:22.545876 21873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "0259c34184cd4ff59e80b9a8899d75fb"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:22.545982 21873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:22.590924 21873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:22.591748 21873 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:22.591969 21873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:22.592639 21873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:22.593825 21873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:22.593905 21873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.593977 21873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:22.594026 21873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:22.604377 21873 rpc_server.cc:307] RPC server started. Bound to: 127.20.185.3:37769
I20260812 08:03:22.604489 22123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.185.3:37769 every 8 connection(s)
I20260812 08:03:22.605553 21873 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:03:22.605926 21220 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu as pid 21873
I20260812 08:03:22.606053 21220 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:03:22.615545 22124 heartbeater.cc:344] Connected to a master server at 127.20.185.62:40533
I20260812 08:03:22.615801 22124 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:22.616369 22124 heartbeater.cc:507] Master 127.20.185.62:40533 requested a full tablet report, sending...
I20260812 08:03:22.617668 21298 ts_manager.cc:194] Registered new tserver with Master: 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769)
I20260812 08:03:22.618280 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.185.3:35277
I20260812 08:03:22.621238 21220 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:22.634670 21298 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37850:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:03:22.637382 21298 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:03:22.655273 21505 tablet_service.cc:1511] Processing CreateTablet for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e (DEFAULT_TABLE table=TestTable [id=0fa0bb388e0c4aea8f2c847c49a38d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:03:22.655314 21746 tablet_service.cc:1511] Processing CreateTablet for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e (DEFAULT_TABLE table=TestTable [id=0fa0bb388e0c4aea8f2c847c49a38d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:03:22.655313 22006 tablet_service.cc:1511] Processing CreateTablet for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e (DEFAULT_TABLE table=TestTable [id=0fa0bb388e0c4aea8f2c847c49a38d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:03:22.656291 21505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:22.656307 21746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:22.656307 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:22.661832 22159 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Bootstrap starting.
I20260812 08:03:22.662738 22161 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap starting.
I20260812 08:03:22.664669 22161 tablet_bootstrap.cc:654] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:22.664673 22159 tablet_bootstrap.cc:654] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:22.665238 22160 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Bootstrap starting.
I20260812 08:03:22.665495 22159 log.cc:826] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:22.665567 22161 log.cc:826] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:22.667416 22160 tablet_bootstrap.cc:654] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:22.667438 22159 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: No bootstrap required, opened a new log
I20260812 08:03:22.667635 22159 ts_tablet_manager.cc:1403] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:03:22.667989 22161 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: No bootstrap required, opened a new log
I20260812 08:03:22.668181 22161 ts_tablet_manager.cc:1403] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
I20260812 08:03:22.668265 22160 log.cc:826] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:22.670217 22160 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: No bootstrap required, opened a new log
I20260812 08:03:22.670408 22160 ts_tablet_manager.cc:1403] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:22.670949 22161 raft_consensus.cc:359] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.670967 22159 raft_consensus.cc:359] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.671164 22161 raft_consensus.cc:740] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0259c34184cd4ff59e80b9a8899d75fb, State: Initialized, Role: FOLLOWER
I20260812 08:03:22.671187 22159 raft_consensus.cc:740] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b72fcd879c485ebe1764d8d3626337, State: Initialized, Role: FOLLOWER
I20260812 08:03:22.671465 22161 consensus_queue.cc:260] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.671482 22159 consensus_queue.cc:260] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.672127 22124 heartbeater.cc:499] Master 127.20.185.62:40533 was elected leader, sending a full tablet report...
I20260812 08:03:22.672346 22161 ts_tablet_manager.cc:1434] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:03:22.672348 22159 ts_tablet_manager.cc:1434] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:03:22.672679 21626 heartbeater.cc:499] Master 127.20.185.62:40533 was elected leader, sending a full tablet report...
I20260812 08:03:22.673532 22160 raft_consensus.cc:359] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.673774 22160 raft_consensus.cc:740] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d798fc1ce844e98105b3a3a1ac665a, State: Initialized, Role: FOLLOWER
I20260812 08:03:22.674103 22160 consensus_queue.cc:260] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.674831 21870 heartbeater.cc:499] Master 127.20.185.62:40533 was elected leader, sending a full tablet report...
I20260812 08:03:22.675019 22160 ts_tablet_manager.cc:1434] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:03:22.690212 21220 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:22.692129 21220 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 40b72fcd879c485ebe1764d8d3626337 to finish bootstrapping
W20260812 08:03:22.695945 21871 tablet.cc:2406] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:22.698803 21220 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 84d798fc1ce844e98105b3a3a1ac665a to finish bootstrapping
I20260812 08:03:22.705332 21220 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 0259c34184cd4ff59e80b9a8899d75fb to finish bootstrapping
W20260812 08:03:22.706674 22125 tablet.cc:2406] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:22.715150 21787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd0ed0211a9d4c429ce7dc12ce5e1c4e"
dest_uuid: "84d798fc1ce844e98105b3a3a1ac665a"
 from {username='slave'} at 127.0.0.1:55196
W20260812 08:03:22.715281 21627 tablet.cc:2406] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:22.715438 21787 raft_consensus.cc:493] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:03:22.715579 21787 raft_consensus.cc:3060] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:22.716655 21787 raft_consensus.cc:515] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.717854 21787 leader_election.cc:290] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [CANDIDATE]: Term 1 election: Requested vote from peers 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769), 40b72fcd879c485ebe1764d8d3626337 (127.20.185.1:45467)
I20260812 08:03:22.722337 22035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0ed0211a9d4c429ce7dc12ce5e1c4e" candidate_uuid: "84d798fc1ce844e98105b3a3a1ac665a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0259c34184cd4ff59e80b9a8899d75fb"
I20260812 08:03:22.722591 22035 raft_consensus.cc:3060] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:22.723030 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0ed0211a9d4c429ce7dc12ce5e1c4e" candidate_uuid: "84d798fc1ce844e98105b3a3a1ac665a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "40b72fcd879c485ebe1764d8d3626337"
I20260812 08:03:22.723251 21543 raft_consensus.cc:3060] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:22.724000 22035 raft_consensus.cc:2468] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d798fc1ce844e98105b3a3a1ac665a in term 1.
I20260812 08:03:22.724496 21667 leader_election.cc:304] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0259c34184cd4ff59e80b9a8899d75fb, 84d798fc1ce844e98105b3a3a1ac665a; no voters: 
I20260812 08:03:22.724539 21543 raft_consensus.cc:2468] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d798fc1ce844e98105b3a3a1ac665a in term 1.
I20260812 08:03:22.724815 22171 raft_consensus.cc:2804] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:22.725096 22171 raft_consensus.cc:697] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 1 LEADER]: Becoming Leader. State: Replica: 84d798fc1ce844e98105b3a3a1ac665a, State: Running, Role: LEADER
I20260812 08:03:22.725808 22171 consensus_queue.cc:237] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:22.729684 21296 catalog_manager.cc:5719] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a reported cstate change: term changed from 0 to 1, leader changed from <none> to 84d798fc1ce844e98105b3a3a1ac665a (127.20.185.2). New cstate: current_term: 1 leader_uuid: "84d798fc1ce844e98105b3a3a1ac665a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } health_report { overall_health: HEALTHY } } }
I20260812 08:03:22.731314 21220 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:03:22.834596 21220 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
I20260812 08:03:23.038029 21220 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
I20260812 08:03:23.119829 22171 consensus_queue.cc:1048] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Connected to new peer: Peer: permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:23.126055 22171 consensus_queue.cc:1048] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:23.609555 21220 consensus_peer_health_status-itest.cc:134] Test: HEALTHY -> UNKNOWN -> HEALTHY
I20260812 08:03:23.609702 21220 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu with pid 21873
W20260812 08:03:23.922261 21667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111)
W20260812 08:03:23.923372 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:24.668962 21220 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
/tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.185.3:37769
--local_ip_for_outbound_sockets=127.20.185.3
--tserver_master_addrs=127.20.185.62:40533
--webserver_port=39699
--webserver_interface=127.20.185.3
--builtin_ntp_servers=127.20.185.20:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20260812 08:03:24.786034 22206 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:03:24.786293 22206 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:03:24.786326 22206 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:24.786376 22206 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:24.786463 22206 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:24.789950 22206 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:03:24.790012 22206 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:03:24.790053 22206 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:24.790203 22206 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:03:24.790236 22206 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.185.3
I20260812 08:03:24.794266 22206 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.185.20:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.185.3:37769
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.20.185.3
--webserver_port=39699
--tserver_master_addrs=127.20.185.62:40533
--never_fsync=true
--heap_profile_path=/tmp/kudu.22206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.185.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:24.795531 22206 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:24.797294 22206 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:24.804545 22211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:24.804541 22213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:24.804548 22217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:24.805016 22206 server_base.cc:1061] running on GCE node
I20260812 08:03:24.805365 22206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:24.805985 22206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:24.807188 22206 hybrid_clock.cc:648] HybridClock initialized: now 1786521804807169 us; error 30 us; skew 500 ppm
I20260812 08:03:24.809209 22206 webserver.cc:533] Webserver started at http://127.20.185.3:39699/ using document root <none> and password file <none>
I20260812 08:03:24.809782 22206 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:24.809865 22206 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:24.813310 22206 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:24.815423 22230 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:24.816531 22206 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:24.816629 22206 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "0259c34184cd4ff59e80b9a8899d75fb"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:24.817107 22206 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:24.829427 22206 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:24.830047 22206 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:24.830196 22206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:24.830720 22206 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:24.831924 22243 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:24.835624 22206 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:24.835721 22206 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:03:24.835819 22206 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:24.837584 22206 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:24.837664 22206 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:24.837984 22243 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap starting.
I20260812 08:03:24.847420 22243 log.cc:826] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:24.850149 22243 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:24.850600 22243 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap complete.
I20260812 08:03:24.850910 22206 rpc_server.cc:307] RPC server started. Bound to: 127.20.185.3:37769
I20260812 08:03:24.851063 22428 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.185.3:37769 every 8 connection(s)
I20260812 08:03:24.851153 22243 ts_tablet_manager.cc:1403] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent bootstrapping tablet: real 0.013s	user 0.002s	sys 0.009s
I20260812 08:03:24.852041 22206 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:03:24.854243 22243 raft_consensus.cc:359] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:24.854693 22243 raft_consensus.cc:740] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0259c34184cd4ff59e80b9a8899d75fb, State: Initialized, Role: FOLLOWER
I20260812 08:03:24.855050 22243 consensus_queue.cc:260] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:24.856007 22243 ts_tablet_manager.cc:1434] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:03:24.856722 21220 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu as pid 22206
I20260812 08:03:24.861033 22429 heartbeater.cc:344] Connected to a master server at 127.20.185.62:40533
I20260812 08:03:24.861289 22429 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:24.861821 22429 heartbeater.cc:507] Master 127.20.185.62:40533 requested a full tablet report, sending...
I20260812 08:03:24.863823 21298 ts_manager.cc:194] Re-registered known tserver with Master: 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769)
I20260812 08:03:24.864616 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.185.3:45947
I20260812 08:03:24.866390 22429 heartbeater.cc:499] Master 127.20.185.62:40533 was elected leader, sending a full tablet report...
I20260812 08:03:25.896612 21220 consensus_peer_health_status-itest.cc:145] Test: HEALTHY -> UNKNOWN -> FAILED -> HEALTHY
W20260812 08:03:30.106125 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Timed out: UpdateConsensus RPC to 127.20.185.3:37769 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:03:32.416888 21667 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.20.185.3:37769 timed out after 2.000s (SENT) [suppressed 2 similar messages]
I20260812 08:03:34.512794 22469 consensus_queue.cc:579] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Leader has been unable to successfully communicate with peer 0259c34184cd4ff59e80b9a8899d75fb for more than 6 seconds (8.803s)
I20260812 08:03:35.135803 21220 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu with pid 22206
W20260812 08:03:35.557193 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:03:37.851617 21667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260812 08:03:37.852423 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:03:40.582898 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 08:03:41.205610 22478 consensus_queue.cc:579] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Leader has been unable to successfully communicate with peer 0259c34184cd4ff59e80b9a8899d75fb for more than 6 seconds (6.087s)
I20260812 08:03:41.237681 21220 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
/tmp/dist-test-taskDLXVdx/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.185.3:37769
--local_ip_for_outbound_sockets=127.20.185.3
--tserver_master_addrs=127.20.185.62:40533
--webserver_port=39699
--webserver_interface=127.20.185.3
--builtin_ntp_servers=127.20.185.20:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20260812 08:03:41.353138 22512 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:03:41.353361 22512 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:03:41.353395 22512 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:41.353415 22512 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:41.353458 22512 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:41.356638 22512 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:03:41.356690 22512 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:03:41.356726 22512 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:41.356786 22512 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:03:41.356813 22512 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.185.3
I20260812 08:03:41.360792 22512 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.185.20:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=6
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.185.3:37769
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.20.185.3
--webserver_port=39699
--tserver_master_addrs=127.20.185.62:40533
--never_fsync=true
--heap_profile_path=/tmp/kudu.22512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.185.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:41.361968 22512 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:41.363122 22512 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:41.370177 22528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:41.370232 22521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:41.370337 22512 server_base.cc:1061] running on GCE node
W20260812 08:03:41.370239 22523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:41.370867 22512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:41.371412 22512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:41.372601 22512 hybrid_clock.cc:648] HybridClock initialized: now 1786521821372577 us; error 36 us; skew 500 ppm
I20260812 08:03:41.374619 22512 webserver.cc:533] Webserver started at http://127.20.185.3:39699/ using document root <none> and password file <none>
I20260812 08:03:41.375209 22512 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:41.375298 22512 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:41.378890 22512 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:41.380915 22540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:41.381922 22512 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:41.382059 22512 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "0259c34184cd4ff59e80b9a8899d75fb"
format_stamp: "Formatted at 2026-08-12 08:03:22 on dist-test-slave-zh2d"
I20260812 08:03:41.382481 22512 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:41.404728 22512 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:41.405443 22512 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:41.405647 22512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:41.406260 22512 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:41.407552 22551 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:41.411042 22512 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:41.411127 22512 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:03:41.411216 22512 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:41.412686 22512 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:41.412756 22512 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:03:41.413115 22551 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap starting.
I20260812 08:03:41.421151 22551 log.cc:826] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:41.423837 22551 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:41.424266 22551 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap complete.
I20260812 08:03:41.424386 22512 rpc_server.cc:307] RPC server started. Bound to: 127.20.185.3:37769
I20260812 08:03:41.424513 22730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.185.3:37769 every 8 connection(s)
I20260812 08:03:41.424897 22551 ts_tablet_manager.cc:1403] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent bootstrapping tablet: real 0.012s	user 0.012s	sys 0.000s
I20260812 08:03:41.425491 22512 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:03:41.428208 22551 raft_consensus.cc:359] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:41.428586 22551 raft_consensus.cc:740] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0259c34184cd4ff59e80b9a8899d75fb, State: Initialized, Role: FOLLOWER
I20260812 08:03:41.428985 22551 consensus_queue.cc:260] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } } peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:41.429929 22551 ts_tablet_manager.cc:1434] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:41.433748 22731 heartbeater.cc:344] Connected to a master server at 127.20.185.62:40533
I20260812 08:03:41.434010 22731 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:41.434531 22731 heartbeater.cc:507] Master 127.20.185.62:40533 requested a full tablet report, sending...
I20260812 08:03:41.435130 21220 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu as pid 22512
I20260812 08:03:41.436369 21298 ts_manager.cc:194] Re-registered known tserver with Master: 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769)
I20260812 08:03:41.437211 21298 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.20.185.3:52573
I20260812 08:03:41.439159 22731 heartbeater.cc:499] Master 127.20.185.62:40533 was elected leader, sending a full tablet report...
I20260812 08:03:42.473536 21220 consensus_peer_health_status-itest.cc:174] Test: HEALTHY -> FAILED_UNRECOVERABLE
I20260812 08:03:42.496953 21220 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20260812 08:03:42.497359 21220 raft_consensus-itest-base.cc:268] Waiting until we've written at least 4MB...
I20260812 08:03:42.574554 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 2761366 bytes log retention, and flush 4038921 bytes memory
I20260812 08:03:42.596616 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 3418742 bytes log retention, and flush 5079305 bytes memory
I20260812 08:03:42.630505 21220 raft_consensus-itest-base.cc:274] Waiting for log GC on 84d798fc1ce844e98105b3a3a1ac665a
I20260812 08:03:42.649349 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.074s	user 0.049s	sys 0.000s Metrics: {"bytes_written":135869,"cfile_init":1,"compiler_manager_pool.queue_time_us":3154,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":696,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":24,"thread_start_us":278,"threads_started":2}
I20260812 08:03:42.650652 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 2761366 bytes of WAL
I20260812 08:03:42.650373 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.053s	user 0.047s	sys 0.004s Metrics: {"bytes_written":135937,"cfile_init":1,"compiler_manager_pool.queue_time_us":13426,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":755,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":30,"thread_start_us":272,"threads_started":2}
I20260812 08:03:42.651006 21671 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 3 log segments from log reader
I20260812 08:03:42.651129 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000001 (ops 1-8)
I20260812 08:03:42.651376 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 2629751 bytes of WAL
I20260812 08:03:42.651453 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000002 (ops 9-15)
I20260812 08:03:42.651556 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000003 (ops 16-22)
I20260812 08:03:42.651892 21433 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 3 log segments from log reader
I20260812 08:03:42.652025 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000001 (ops 1-8)
I20260812 08:03:42.652143 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000002 (ops 9-14)
I20260812 08:03:42.652515 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000003 (ops 15-21)
I20260812 08:03:42.652743 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {}
I20260812 08:03:42.653185 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 1840874 bytes log retention, and flush 2998537 bytes memory
I20260812 08:03:42.653683 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.002s	user 0.000s	sys 0.001s Metrics: {}
I20260812 08:03:42.654134 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 469 bytes on disk
I20260812 08:03:42.654795 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20260812 08:03:42.661564 21220 raft_consensus-itest-base.cc:279] Log GC complete on 84d798fc1ce844e98105b3a3a1ac665a
I20260812 08:03:42.669600 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.016s	user 0.015s	sys 0.000s Metrics: {"bytes_written":135803,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":227,"dirs.run_wall_time_us":1426,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":678,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":13}
I20260812 08:03:42.670457 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 688 bytes on disk
I20260812 08:03:42.671095 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":81,"lbm_reads_lt_1ms":8}
I20260812 08:03:42.671510 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): perf score=0.920316
I20260812 08:03:42.709173 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.037s	user 0.037s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_cache_hit":10,"cfile_cache_hit_bytes":262392,"cfile_cache_miss":26,"cfile_cache_miss_bytes":264316,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":779,"dirs.run_cpu_time_us":234,"dirs.run_wall_time_us":1374,"drs_written":1,"lbm_read_time_us":598,"lbm_reads_lt_1ms":46,"lbm_write_time_us":544,"lbm_writes_lt_1ms":23,"mutex_wait_us":24,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":37,"spinlock_wait_cycles":6016,"thread_start_us":449,"threads_started":5}
I20260812 08:03:42.709916 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 549 bytes on disk
I20260812 08:03:42.710443 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
W20260812 08:03:44.517976 21667 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.20.185.3:37769 timed out after 2.000s (SENT) [suppressed 6 similar messages]
I20260812 08:03:44.663111 21220 raft_consensus-itest-base.cc:295] Servers converged with original term 1
I20260812 08:03:44.663188 21220 raft_consensus-itest-base.cc:300] Resuming 0259c34184cd4ff59e80b9a8899d75fb
I20260812 08:03:44.670262 22656 raft_consensus.cc:1217] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 08:03:44.670912 22808 consensus_queue.cc:753] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: The logs necessary to catch up peer 0259c34184cd4ff59e80b9a8899d75fb have been garbage collected. The follower will never be able to catch up (Not found: failed to read ops 3..32: Segment 1 which contained index 3 has been GCed)
I20260812 08:03:44.671029 22808 consensus_queue.cc:579] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: The logs necessary to catch up peer 0259c34184cd4ff59e80b9a8899d75fb have been garbage collected. The replica will never be able to catch up
I20260812 08:03:44.672744 21220 consensus_peer_health_status-itest.cc:179] Recovering test replica...
I20260812 08:03:44.674705 21787 consensus_queue.cc:237] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 38, Committed index: 38, Last appended: 1.38, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } }
I20260812 08:03:44.676479 21541 raft_consensus.cc:1275] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 1 FOLLOWER]: Refusing update from remote peer 84d798fc1ce844e98105b3a3a1ac665a: Log matching property violated. Preceding OpId in replica: term: 1 index: 38. Preceding OpId from leader: term: 1 index: 39. (index mismatch)
I20260812 08:03:44.677194 22816 consensus_queue.cc:1048] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Connected to new peer: Peer: permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
I20260812 08:03:44.679514 22808 raft_consensus.cc:2955] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 1 LEADER]: Committing config change with OpId 1.39: config changed from index -1 to 39, VOTER 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3) evicted. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } }
I20260812 08:03:44.679947 21541 raft_consensus.cc:2955] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 1 FOLLOWER]: Committing config change with OpId 1.39: config changed from index -1 to 39, VOTER 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3) evicted. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } }
I20260812 08:03:44.682762 21298 catalog_manager.cc:5719] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a reported cstate change: config changed from index -1 to 39, VOTER 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3) evicted. New cstate: current_term: 1 leader_uuid: "84d798fc1ce844e98105b3a3a1ac665a" committed_config { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } health_report { overall_health: HEALTHY } } }
I20260812 08:03:44.691552 22625 tablet_service.cc:1558] Processing DeleteTablet for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e with delete_type TABLET_DATA_TOMBSTONED (TS 0259c34184cd4ff59e80b9a8899d75fb not found in new config with opid_index 39) from {username='slave'} at 127.0.0.1:40448
I20260812 08:03:44.692152 22837 tablet_replica.cc:333] stopping tablet replica
I20260812 08:03:44.692482 22837 raft_consensus.cc:2243] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:03:44.692745 22837 pending_rounds.cc:70] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Trying to abort 1 pending ops.
I20260812 08:03:44.692808 22837 pending_rounds.cc:77] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317593385024188416 op_type: WRITE_OP write_request { tablet_id: "bd0ed0211a9d4c429ce7dc12ce5e1c4e" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\342\260\333\177\032\326\'\222\000\000\000\000\000\000\000\000\000\000\002\000\000\000\000\000" indirect_data: "<redacted>""00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
I20260812 08:03:44.695288 22837 raft_consensus.cc:2272] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:03:44.696626 22837 ts_tablet_manager.cc:1916] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:03:44.700004 22837 ts_tablet_manager.cc:1929] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260812 08:03:44.700116 22837 log.cc:1199] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Deleting WAL directory at /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-2/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e
I20260812 08:03:44.700829 21279 catalog_manager.cc:5050] TS 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e (table TestTable [id=0fa0bb388e0c4aea8f2c847c49a38d2f]) successfully deleted
I20260812 08:03:44.701885 21787 consensus_queue.cc:237] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } attrs { } }
W20260812 08:03:44.703804 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:44.703840 21541 raft_consensus.cc:1275] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 1 FOLLOWER]: Refusing update from remote peer 84d798fc1ce844e98105b3a3a1ac665a: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20260812 08:03:44.704437 22816 consensus_queue.cc:1048] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Connected to new peer: Peer: permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260812 08:03:44.706538 22815 raft_consensus.cc:2955] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [term 1 LEADER]: Committing config change with OpId 1.40: config changed from index 39 to 40, VOTER 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3) added. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } attrs { } } }
I20260812 08:03:44.707121 21541 raft_consensus.cc:2955] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337 [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 39 to 40, VOTER 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3) added. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } attrs { } } }
I20260812 08:03:44.709316 21298 catalog_manager.cc:5719] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a reported cstate change: config changed from index 39 to 40, VOTER 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3) added. New cstate: current_term: 1 leader_uuid: "84d798fc1ce844e98105b3a3a1ac665a" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } attrs { } health_report { overall_health: UNKNOWN } } }
I20260812 08:03:45.110211 22841 ts_tablet_manager.cc:933] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Initiating tablet copy from peer 84d798fc1ce844e98105b3a3a1ac665a (127.20.185.2:43331)
I20260812 08:03:45.110968 22841 tablet_copy_client.cc:323] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: tablet copy: Beginning tablet copy session from remote peer at address 127.20.185.2:43331
I20260812 08:03:45.115211 21826 tablet_copy_service.cc:140] P 84d798fc1ce844e98105b3a3a1ac665a: Received BeginTabletCopySession request for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e from peer 0259c34184cd4ff59e80b9a8899d75fb ({username='slave'} at 127.20.185.3:54945)
I20260812 08:03:45.115433 21826 tablet_copy_service.cc:161] P 84d798fc1ce844e98105b3a3a1ac665a: Beginning new tablet copy session on tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e from peer 0259c34184cd4ff59e80b9a8899d75fb at {username='slave'} at 127.20.185.3:54945: session id = 0259c34184cd4ff59e80b9a8899d75fb-bd0ed0211a9d4c429ce7dc12ce5e1c4e
I20260812 08:03:45.117116 21826 tablet_copy_source_session.cc:215] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Tablet Copy: opened 5 blocks and 3 log segments
I20260812 08:03:45.118857 22841 ts_tablet_manager.cc:1916] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:03:45.120694 22841 ts_tablet_manager.cc:1929] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.2
I20260812 08:03:45.121167 22841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:45.122498 22841 tablet_copy_client.cc:806] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: tablet copy: Starting download of 5 data blocks...
I20260812 08:03:45.130982 22841 tablet_copy_client.cc:670] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: tablet copy: Starting download of 3 WAL segments...
I20260812 08:03:45.141363 22841 tablet_copy_client.cc:538] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:03:45.143316 22841 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap starting.
I20260812 08:03:45.153967 22841 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=4 ignored=4} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 3 replicates
I20260812 08:03:45.159108 22841 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=12} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates
I20260812 08:03:45.162631 22841 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap replayed 3/3 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=16} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates
I20260812 08:03:45.163021 22841 tablet_bootstrap.cc:492] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Bootstrap complete.
I20260812 08:03:45.163756 22841 ts_tablet_manager.cc:1403] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260812 08:03:45.164505 22841 raft_consensus.cc:359] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } attrs { } }
I20260812 08:03:45.164666 22841 raft_consensus.cc:740] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0259c34184cd4ff59e80b9a8899d75fb, State: Initialized, Role: FOLLOWER
I20260812 08:03:45.164906 22841 consensus_queue.cc:260] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 1.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "40b72fcd879c485ebe1764d8d3626337" member_type: VOTER last_known_addr { host: "127.20.185.1" port: 45467 } } peers { permanent_uuid: "84d798fc1ce844e98105b3a3a1ac665a" member_type: VOTER last_known_addr { host: "127.20.185.2" port: 43331 } } peers { permanent_uuid: "0259c34184cd4ff59e80b9a8899d75fb" member_type: VOTER last_known_addr { host: "127.20.185.3" port: 37769 } attrs { } }
I20260812 08:03:45.165321 22841 ts_tablet_manager.cc:1434] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 08:03:45.166322 21825 tablet_copy_service.cc:342] P 84d798fc1ce844e98105b3a3a1ac665a: Request end of tablet copy session 0259c34184cd4ff59e80b9a8899d75fb-bd0ed0211a9d4c429ce7dc12ce5e1c4e received from {username='slave'} at 127.20.185.3:54945
I20260812 08:03:45.166505 21825 tablet_copy_service.cc:434] P 84d798fc1ce844e98105b3a3a1ac665a: ending tablet copy session 0259c34184cd4ff59e80b9a8899d75fb-bd0ed0211a9d4c429ce7dc12ce5e1c4e on tablet bd0ed0211a9d4c429ce7dc12ce5e1c4e with peer 0259c34184cd4ff59e80b9a8899d75fb
I20260812 08:03:45.167853 21220 consensus_peer_health_status-itest.cc:203] Test: HEALTHY -> UNKNOWN -> FAILED -> FAILED_UNRECOVERABLE
I20260812 08:03:45.366472 22732 maintenance_manager.cc:419] P 0259c34184cd4ff59e80b9a8899d75fb: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 549 bytes on disk
I20260812 08:03:45.367588 22549 maintenance_manager.cc:643] P 0259c34184cd4ff59e80b9a8899d75fb: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20260812 08:03:45.682904 22656 raft_consensus.cc:1217] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 0259c34184cd4ff59e80b9a8899d75fb [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.39->[1.40-1.40]   Dedup: 1.40->[]
I20260812 08:03:45.693033 21220 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu with pid 22512
I20260812 08:03:45.723304 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 1840874 bytes of WAL
I20260812 08:03:45.723562 21671 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 2 log segments from log reader
I20260812 08:03:45.723613 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000004 (ops 23-29)
I20260812 08:03:45.723646 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000005 (ops 30-36)
I20260812 08:03:45.724313 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
W20260812 08:03:46.135535 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:46.271556 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 788991 bytes of WAL
I20260812 08:03:46.271930 21433 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 1 log segments from log reader
I20260812 08:03:46.271992 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000004 (ops 22-27)
I20260812 08:03:46.272390 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
W20260812 08:03:48.569409 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:03:49.566071 21667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260812 08:03:51.118786 21667 consensus_peers.cc:597] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a -> Peer 0259c34184cd4ff59e80b9a8899d75fb (127.20.185.3:37769): Couldn't send request to peer 0259c34184cd4ff59e80b9a8899d75fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.185.3:37769: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 08:03:51.931143 22873 consensus_queue.cc:579] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: Leader has been unable to successfully communicate with peer 0259c34184cd4ff59e80b9a8899d75fb for more than 6 seconds (6.247s)
I20260812 08:03:52.818272 21220 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20260812 08:03:52.818605 21220 raft_consensus-itest-base.cc:268] Waiting until we've written at least 4MB...
I20260812 08:03:52.857232 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 1841709 bytes log retention, and flush 1958153 bytes memory
I20260812 08:03:52.877154 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.020s	user 0.012s	sys 0.005s Metrics: {"bytes_written":135803,"cfile_init":1,"dirs.queue_time_us":2367,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":828,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":10,"thread_start_us":137,"threads_started":1}
I20260812 08:03:52.877873 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 921291 bytes of WAL
I20260812 08:03:52.878194 21671 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 1 log segments from log reader
I20260812 08:03:52.878316 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000006 (ops 37-45)
I20260812 08:03:52.878743 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"spinlock_wait_cycles":94976}
I20260812 08:03:52.879098 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 1840874 bytes log retention, and flush 1958153 bytes memory
I20260812 08:03:52.896756 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.017s	user 0.015s	sys 0.000s Metrics: {"bytes_written":135803,"cfile_init":1,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":159,"dirs.run_wall_time_us":1098,"drs_written":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4,"lbm_write_time_us":774,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9}
I20260812 08:03:52.899878 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 920418 bytes of WAL
I20260812 08:03:52.901041 21671 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 1 log segments from log reader
I20260812 08:03:52.901154 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000007 (ops 46-52)
I20260812 08:03:52.901607 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20260812 08:03:52.901979 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 502 bytes on disk
I20260812 08:03:52.902630 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":132,"lbm_reads_lt_1ms":8}
I20260812 08:03:52.903697 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): perf score=1.942125
I20260812 08:03:52.906428 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 4865906 bytes log retention, and flush 6119689 bytes memory
I20260812 08:03:52.923889 21220 raft_consensus-itest-base.cc:274] Waiting for log GC on 84d798fc1ce844e98105b3a3a1ac665a
I20260812 08:03:52.924124 21220 raft_consensus-itest-base.cc:279] Log GC complete on 84d798fc1ce844e98105b3a3a1ac665a
I20260812 08:03:52.947778 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.041s	user 0.038s	sys 0.001s Metrics: {"bytes_written":136001,"cfile_init":1,"dirs.queue_time_us":268,"dirs.run_cpu_time_us":283,"dirs.run_wall_time_us":1463,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":598,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":39,"thread_start_us":169,"threads_started":1}
I20260812 08:03:52.948776 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 3945514 bytes of WAL
I20260812 08:03:52.949048 21433 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 5 log segments from log reader
I20260812 08:03:52.949095 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000005 (ops 28-34)
I20260812 08:03:52.949149 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000006 (ops 35-41)
I20260812 08:03:52.949195 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000007 (ops 42-46)
I20260812 08:03:52.949235 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000008 (ops 47-53)
I20260812 08:03:52.949271 21433 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 40b72fcd879c485ebe1764d8d3626337: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-0/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000009 (ops 54-59)
I20260812 08:03:52.950464 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20260812 08:03:52.950819 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): perf score=0.993463
I20260812 08:03:52.964406 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.060s	user 0.058s	sys 0.000s Metrics: {"bytes_written":136129,"cfile_cache_hit":15,"cfile_cache_hit_bytes":393588,"cfile_cache_miss":39,"cfile_cache_miss_bytes":396710,"cfile_init":7,"delta_iterators_relevant":6,"dirs.queue_time_us":978,"dirs.run_cpu_time_us":183,"dirs.run_wall_time_us":1321,"drs_written":1,"lbm_read_time_us":1033,"lbm_reads_lt_1ms":67,"lbm_write_time_us":555,"lbm_writes_lt_1ms":23,"num_input_rowsets":3,"peak_mem_usage":98304,"rows_written":56,"thread_start_us":506,"threads_started":6}
I20260812 08:03:52.965144 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): free 920456 bytes of WAL
I20260812 08:03:52.965395 21671 log_reader.cc:385] T bd0ed0211a9d4c429ce7dc12ce5e1c4e: removed 1 log segments from log reader
I20260812 08:03:52.965466 21671 log.cc:1079] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a: Deleting log segment in path: /tmp/dist-test-taskDLXVdx/test-tmp/consensus_peer_health_status-itest.0.ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions.1786521801721587-21220-0/raft_consensus-itest-cluster/ts-1/wal/wals/bd0ed0211a9d4c429ce7dc12ce5e1c4e/wal-000000008 (ops 53-59)
I20260812 08:03:52.965850 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: LogGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20260812 08:03:52.966131 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 1840950 bytes log retention, and flush 2998537 bytes memory
I20260812 08:03:52.991143 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: FlushMRSOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.025s	user 0.023s	sys 0.000s Metrics: {"bytes_written":135869,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":1355,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":524,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":18}
I20260812 08:03:52.991737 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): perf score=0.964198
I20260812 08:03:53.019060 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.068s	user 0.068s	sys 0.000s Metrics: {"bytes_written":136260,"cfile_cache_hit":10,"cfile_cache_hit_bytes":262396,"cfile_cache_miss":26,"cfile_cache_miss_bytes":265568,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1007,"dirs.run_cpu_time_us":226,"dirs.run_wall_time_us":1323,"drs_written":1,"lbm_read_time_us":613,"lbm_reads_lt_1ms":50,"lbm_write_time_us":535,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":69,"thread_start_us":507,"threads_started":5}
I20260812 08:03:53.019712 21627 maintenance_manager.cc:419] P 40b72fcd879c485ebe1764d8d3626337: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 940 bytes on disk
I20260812 08:03:53.020164 21433 maintenance_manager.cc:643] P 40b72fcd879c485ebe1764d8d3626337: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
I20260812 08:03:53.051309 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: CompactRowSetsOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.059s	user 0.059s	sys 0.000s Metrics: {"bytes_written":136324,"cfile_cache_hit":10,"cfile_cache_hit_bytes":262394,"cfile_cache_miss":26,"cfile_cache_miss_bytes":265830,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":393,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1454,"drs_written":1,"lbm_read_time_us":593,"lbm_reads_lt_1ms":54,"lbm_write_time_us":519,"lbm_writes_lt_1ms":23,"mutex_wait_us":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":74,"spinlock_wait_cycles":3968}
I20260812 08:03:53.052075 21871 maintenance_manager.cc:419] P 84d798fc1ce844e98105b3a3a1ac665a: Scheduling UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e): 1000 bytes on disk
I20260812 08:03:53.052516 21671 maintenance_manager.cc:643] P 84d798fc1ce844e98105b3a3a1ac665a: UndoDeltaBlockGCOp(bd0ed0211a9d4c429ce7dc12ce5e1c4e) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
I20260812 08:03:53.101428 22921 consensus_queue.cc:753] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: The logs necessary to catch up peer 0259c34184cd4ff59e80b9a8899d75fb have been garbage collected. The follower will never be able to catch up (Not found: failed to read ops 41..70: Segment 6 which contained index 41 has been GCed)
I20260812 08:03:53.101543 22921 consensus_queue.cc:579] T bd0ed0211a9d4c429ce7dc12ce5e1c4e P 84d798fc1ce844e98105b3a3a1ac665a [LEADER]: The logs necessary to catch up peer 0259c34184cd4ff59e80b9a8899d75fb have been garbage collected. The replica will never be able to catch up
I20260812 08:03:54.925938 21220 raft_consensus-itest-base.cc:295] Servers converged with original term 1
I20260812 08:03:54.928120 21220 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu with pid 21400
I20260812 08:03:54.948638 21220 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu with pid 21630
I20260812 08:03:54.966746 21220 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskDLXVdx/build/debug/bin/kudu with pid 21248
2026-08-12T08:03:54Z chronyd exiting
[       OK ] ConsensusPeerHealthStatusITest.TestPeerHealthStatusTransitions (33268 ms)
[----------] 1 test from ConsensusPeerHealthStatusITest (33268 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (33268 ms total)
[  PASSED  ] 1 test.
