[==========] Running 10 tests from 3 test suites.
[----------] Global test environment set-up.
[----------] 4 tests from TabletReplacementITest
[ RUN      ] TabletReplacementITest.TestMasterTombstoneEvictedReplica
2026-08-12T06:36:09Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:09Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 06:36:09.476709 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:41649
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:41649
--master_add_server_when_underreplicated=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:36:09.577171 29392 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:09.577369 29392 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:09.577409 29392 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:09.580657 29392 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:09.580718 29392 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:09.580739 29392 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:09.580756 29392 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:09.584481 29392 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:41649
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:41649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.29392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:09.585572 29392 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:09.586697 29392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:09.592826 29400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:09.592862 29397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:09.592959 29392 server_base.cc:1061] running on GCE node
W20260812 06:36:09.592850 29398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:09.593568 29392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:09.594359 29392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:09.595511 29392 hybrid_clock.cc:648] HybridClock initialized: now 1786516569595463 us; error 68 us; skew 500 ppm
I20260812 06:36:09.597441 29392 webserver.cc:533] Webserver started at http://127.28.177.190:37431/ using document root <none> and password file <none>
I20260812 06:36:09.598006 29392 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:09.598055 29392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:09.598333 29392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:09.599782 29392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "62f2209ce18b4d4d8884552baf1b1469"
format_stamp: "Formatted at 2026-08-12 06:36:09 on dist-test-slave-cbbz"
I20260812 06:36:09.600314 29392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "62f2209ce18b4d4d8884552baf1b1469"
format_stamp: "Formatted at 2026-08-12 06:36:09 on dist-test-slave-cbbz"
I20260812 06:36:09.603502 29392 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:09.605547 29406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:09.606505 29392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:36:09.606637 29392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "62f2209ce18b4d4d8884552baf1b1469"
format_stamp: "Formatted at 2026-08-12 06:36:09 on dist-test-slave-cbbz"
I20260812 06:36:09.606734 29392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:09.639250 29392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:09.639961 29392 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:09.640221 29392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:09.647603 29392 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:41649
I20260812 06:36:09.647621 29470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:41649 every 8 connection(s)
I20260812 06:36:09.648626 29392 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:09.651496 29471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:09.652132 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 29392
I20260812 06:36:09.652338 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:09.657071 29471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469: Bootstrap starting.
I20260812 06:36:09.659049 29471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:09.659790 29471 log.cc:826] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:09.661306 29471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469: No bootstrap required, opened a new log
I20260812 06:36:09.663811 29471 raft_consensus.cc:359] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f2209ce18b4d4d8884552baf1b1469" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41649 } }
I20260812 06:36:09.664026 29471 raft_consensus.cc:385] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:09.664109 29471 raft_consensus.cc:740] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62f2209ce18b4d4d8884552baf1b1469, State: Initialized, Role: FOLLOWER
I20260812 06:36:09.664489 29471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f2209ce18b4d4d8884552baf1b1469" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41649 } }
I20260812 06:36:09.664633 29471 raft_consensus.cc:399] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:09.664718 29471 raft_consensus.cc:493] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:09.664851 29471 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:09.665589 29471 raft_consensus.cc:515] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f2209ce18b4d4d8884552baf1b1469" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41649 } }
I20260812 06:36:09.665934 29471 leader_election.cc:304] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62f2209ce18b4d4d8884552baf1b1469; no voters: 
I20260812 06:36:09.666203 29471 leader_election.cc:290] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:09.666347 29477 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:09.666570 29477 raft_consensus.cc:697] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [term 1 LEADER]: Becoming Leader. State: Replica: 62f2209ce18b4d4d8884552baf1b1469, State: Running, Role: LEADER
I20260812 06:36:09.666868 29477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f2209ce18b4d4d8884552baf1b1469" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41649 } }
I20260812 06:36:09.667217 29471 sys_catalog.cc:565] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:09.668398 29478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62f2209ce18b4d4d8884552baf1b1469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f2209ce18b4d4d8884552baf1b1469" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41649 } } }
I20260812 06:36:09.668525 29478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:09.668939 29486 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:09.668939 29479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62f2209ce18b4d4d8884552baf1b1469. Latest consensus state: current_term: 1 leader_uuid: "62f2209ce18b4d4d8884552baf1b1469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f2209ce18b4d4d8884552baf1b1469" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41649 } } }
I20260812 06:36:09.669130 29479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:09.671754 29486 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:09.676322 29486 catalog_manager.cc:1383] Generated new cluster ID: 9e8404b9dde140e5b349fd43610bd8d5
I20260812 06:36:09.676385 29486 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:09.708011 29486 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:09.708889 29486 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:09.719192 29486 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 62f2209ce18b4d4d8884552baf1b1469: Generated new TSK 0
I20260812 06:36:09.719779 29486 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:09.723008 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--builtin_ntp_servers=127.28.177.148:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 06:36:09.829203 29497 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:09.829398 29497 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:09.829423 29497 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:09.829501 29497 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:09.832778 29497 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:09.832875 29497 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:09.836587 29497 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--never_fsync=true
--heap_profile_path=/tmp/kudu.29497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:09.837548 29497 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:09.838766 29497 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:09.845119 29502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:09.845122 29507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:09.845247 29497 server_base.cc:1061] running on GCE node
W20260812 06:36:09.845122 29503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:09.845711 29497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:09.846248 29497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:09.847402 29497 hybrid_clock.cc:648] HybridClock initialized: now 1786516569847385 us; error 28 us; skew 500 ppm
I20260812 06:36:09.849085 29497 webserver.cc:533] Webserver started at http://127.28.177.129:32821/ using document root <none> and password file <none>
I20260812 06:36:09.849620 29497 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:09.849671 29497 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:09.849885 29497 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:09.851336 29497 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "03d05be7f5a94ec3a387e1deb46148dc"
format_stamp: "Formatted at 2026-08-12 06:36:09 on dist-test-slave-cbbz"
I20260812 06:36:09.851790 29497 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "03d05be7f5a94ec3a387e1deb46148dc"
format_stamp: "Formatted at 2026-08-12 06:36:09 on dist-test-slave-cbbz"
I20260812 06:36:09.854846 29497 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:09.856892 29513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:09.857743 29497 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:09.857856 29497 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "03d05be7f5a94ec3a387e1deb46148dc"
format_stamp: "Formatted at 2026-08-12 06:36:09 on dist-test-slave-cbbz"
I20260812 06:36:09.857951 29497 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:09.897856 29497 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:09.898548 29497 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:09.898761 29497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:09.899446 29497 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:09.900490 29497 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:09.900563 29497 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:09.900635 29497 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:09.900676 29497 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:09.910266 29497 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:34795
I20260812 06:36:09.910305 29646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:34795 every 8 connection(s)
I20260812 06:36:09.911219 29497 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:09.919600 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 29497
I20260812 06:36:09.919730 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:09.920545 29647 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41649
I20260812 06:36:09.920815 29647 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:09.921393 29647 heartbeater.cc:507] Master 127.28.177.190:41649 requested a full tablet report, sending...
I20260812 06:36:09.922101 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--builtin_ntp_servers=127.28.177.148:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:09.922972 29425 ts_manager.cc:194] Registered new tserver with Master: 03d05be7f5a94ec3a387e1deb46148dc (127.28.177.129:34795)
I20260812 06:36:09.924409 29425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:36733
W20260812 06:36:10.026767 29650 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:10.026963 29650 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:10.026984 29650 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:10.027021 29650 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:10.030270 29650 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:10.030366 29650 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:10.034003 29650 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--never_fsync=true
--heap_profile_path=/tmp/kudu.29650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:10.034900 29650 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:10.035916 29650 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:10.042193 29661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.042229 29659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.042228 29657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:10.042459 29650 server_base.cc:1061] running on GCE node
I20260812 06:36:10.042807 29650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:10.043326 29650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:10.044502 29650 hybrid_clock.cc:648] HybridClock initialized: now 1786516570044485 us; error 32 us; skew 500 ppm
I20260812 06:36:10.046128 29650 webserver.cc:533] Webserver started at http://127.28.177.130:35517/ using document root <none> and password file <none>
I20260812 06:36:10.046669 29650 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:10.046754 29650 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:10.046964 29650 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:10.048516 29650 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "82513f07430b4c738a10ab3c947c287e"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.048988 29650 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "82513f07430b4c738a10ab3c947c287e"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.052186 29650 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:10.054191 29667 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.055081 29650 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:10.055223 29650 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "82513f07430b4c738a10ab3c947c287e"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.055327 29650 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:10.087780 29650 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:10.088562 29650 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:10.088769 29650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:10.089366 29650 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:10.090381 29650 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:10.090453 29650 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.090525 29650 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:10.090595 29650 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.100297 29650 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:42801
I20260812 06:36:10.100340 29791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:42801 every 8 connection(s)
I20260812 06:36:10.101210 29650 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:10.108872 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 29650
I20260812 06:36:10.108953 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:10.110628 29792 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41649
I20260812 06:36:10.110865 29792 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:10.111279 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--builtin_ntp_servers=127.28.177.148:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:10.111402 29792 heartbeater.cc:507] Master 127.28.177.190:41649 requested a full tablet report, sending...
I20260812 06:36:10.112389 29425 ts_manager.cc:194] Registered new tserver with Master: 82513f07430b4c738a10ab3c947c287e (127.28.177.130:42801)
I20260812 06:36:10.113056 29425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:38661
W20260812 06:36:10.215994 29795 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:10.216265 29795 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:10.216296 29795 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:10.216336 29795 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:10.219734 29795 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:10.219825 29795 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:10.223474 29795 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--never_fsync=true
--heap_profile_path=/tmp/kudu.29795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:10.224448 29795 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:10.225467 29795 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:10.231462 29802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.231413 29803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.231511 29805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:10.231592 29795 server_base.cc:1061] running on GCE node
I20260812 06:36:10.232061 29795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:10.232580 29795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:10.233755 29795 hybrid_clock.cc:648] HybridClock initialized: now 1786516570233747 us; error 28 us; skew 500 ppm
I20260812 06:36:10.235270 29795 webserver.cc:533] Webserver started at http://127.28.177.131:38871/ using document root <none> and password file <none>
I20260812 06:36:10.235795 29795 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:10.235875 29795 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:10.236086 29795 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:10.237514 29795 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "e93c5425e1e44a2a9286835d4ec70b4b"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.237979 29795 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "e93c5425e1e44a2a9286835d4ec70b4b"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.241029 29795 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:10.243067 29813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.243974 29795 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:10.244100 29795 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "e93c5425e1e44a2a9286835d4ec70b4b"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.244246 29795 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:10.263432 29795 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:10.263995 29795 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:10.264242 29795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:10.264761 29795 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:10.265705 29795 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:10.265779 29795 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.265844 29795 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:10.265894 29795 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.275470 29795 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:46289
I20260812 06:36:10.275504 29940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:46289 every 8 connection(s)
I20260812 06:36:10.276412 29795 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:10.277155 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 29795
I20260812 06:36:10.277235 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:10.279522 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.132:0
--local_ip_for_outbound_sockets=127.28.177.132
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--builtin_ntp_servers=127.28.177.148:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:10.285545 29941 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41649
I20260812 06:36:10.285781 29941 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:10.286258 29941 heartbeater.cc:507] Master 127.28.177.190:41649 requested a full tablet report, sending...
I20260812 06:36:10.287303 29425 ts_manager.cc:194] Registered new tserver with Master: e93c5425e1e44a2a9286835d4ec70b4b (127.28.177.131:46289)
I20260812 06:36:10.288080 29425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:36587
W20260812 06:36:10.383214 29944 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:10.383423 29944 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:10.383448 29944 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:10.383488 29944 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:10.386642 29944 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:10.386745 29944 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.132
I20260812 06:36:10.390405 29944 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--never_fsync=true
--heap_profile_path=/tmp/kudu.29944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:10.391367 29944 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:10.392427 29944 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:10.398736 29953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.398741 29950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:10.398895 29944 server_base.cc:1061] running on GCE node
W20260812 06:36:10.398751 29949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:10.399273 29944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:10.399770 29944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:10.400918 29944 hybrid_clock.cc:648] HybridClock initialized: now 1786516570400901 us; error 28 us; skew 500 ppm
I20260812 06:36:10.402537 29944 webserver.cc:533] Webserver started at http://127.28.177.132:44647/ using document root <none> and password file <none>
I20260812 06:36:10.403074 29944 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:10.403124 29944 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:10.403344 29944 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:10.404837 29944 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data/instance:
uuid: "2bed2803762b49ef87fcdb78cdc2de08"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.405298 29944 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance:
uuid: "2bed2803762b49ef87fcdb78cdc2de08"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.408318 29944 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:10.410310 29959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.411260 29944 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:10.411378 29944 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal
uuid: "2bed2803762b49ef87fcdb78cdc2de08"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.411465 29944 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:10.428732 29944 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:10.429275 29944 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:10.429472 29944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:10.430114 29944 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:10.431161 29944 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:10.431238 29944 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.431299 29944 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:10.431329 29944 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.440856 29944 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.132:46173
I20260812 06:36:10.440904 30091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.132:46173 every 8 connection(s)
I20260812 06:36:10.441720 29944 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
I20260812 06:36:10.445648 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 29944
I20260812 06:36:10.445736 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance
I20260812 06:36:10.447762 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.133:0
--local_ip_for_outbound_sockets=127.28.177.133
--webserver_interface=127.28.177.133
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--builtin_ntp_servers=127.28.177.148:46343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:10.450313 30092 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41649
I20260812 06:36:10.450558 30092 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:10.451030 30092 heartbeater.cc:507] Master 127.28.177.190:41649 requested a full tablet report, sending...
I20260812 06:36:10.452103 29425 ts_manager.cc:194] Registered new tserver with Master: 2bed2803762b49ef87fcdb78cdc2de08 (127.28.177.132:46173)
I20260812 06:36:10.452700 29425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.132:49519
W20260812 06:36:10.550094 30095 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:10.550374 30095 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:10.550424 30095 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:10.550508 30095 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:10.553690 30095 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:10.553860 30095 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.133
I20260812 06:36:10.557512 30095 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data/info.pb
--webserver_interface=127.28.177.133
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41649
--never_fsync=true
--heap_profile_path=/tmp/kudu.30095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.133

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:10.558512 30095 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:10.559634 30095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:10.566126 30101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.566131 30103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:10.566136 30100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:10.566488 30095 server_base.cc:1061] running on GCE node
I20260812 06:36:10.566861 30095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:10.567369 30095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:10.568552 30095 hybrid_clock.cc:648] HybridClock initialized: now 1786516570568531 us; error 33 us; skew 500 ppm
I20260812 06:36:10.570287 30095 webserver.cc:533] Webserver started at http://127.28.177.133:46833/ using document root <none> and password file <none>
I20260812 06:36:10.570847 30095 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:10.570931 30095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:10.571153 30095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:10.572695 30095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data/instance:
uuid: "5f65f848bd434ee2848b711bb1410d89"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.573164 30095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal/instance:
uuid: "5f65f848bd434ee2848b711bb1410d89"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.576290 30095 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:10.578295 30110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.579172 30095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:10.579310 30095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal
uuid: "5f65f848bd434ee2848b711bb1410d89"
format_stamp: "Formatted at 2026-08-12 06:36:10 on dist-test-slave-cbbz"
I20260812 06:36:10.579403 30095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:10.593643 30095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:10.594170 30095 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:10.594352 30095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:10.594844 30095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:10.595750 30095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:10.595827 30095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.595889 30095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:10.595937 30095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:10.605337 30095 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.133:34967
I20260812 06:36:10.605363 30237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.133:34967 every 8 connection(s)
I20260812 06:36:10.606148 30095 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/data/info.pb
I20260812 06:36:10.613853 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 30095
I20260812 06:36:10.613973 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal/instance
I20260812 06:36:10.614591 30238 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41649
I20260812 06:36:10.614837 30238 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:10.615406 30238 heartbeater.cc:507] Master 127.28.177.190:41649 requested a full tablet report, sending...
I20260812 06:36:10.616496 29424 ts_manager.cc:194] Registered new tserver with Master: 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133:34967)
I20260812 06:36:10.617110 29424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.133:38591
I20260812 06:36:10.628475 29382 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 06:36:10.652985 29424 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:10.654019 29424 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260812 06:36:10.670042 29864 tablet_service.cc:1511] Processing CreateTablet for tablet 070def18cedc4f3f984cb9c74f6f36de (DEFAULT_TABLE table=test-workload [id=ca1a988333314f8d8d59d81b53fb225e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:10.671128 29864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070def18cedc4f3f984cb9c74f6f36de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:10.671002 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 070def18cedc4f3f984cb9c74f6f36de (DEFAULT_TABLE table=test-workload [id=ca1a988333314f8d8d59d81b53fb225e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:10.671911 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070def18cedc4f3f984cb9c74f6f36de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:10.675670 29566 tablet_service.cc:1511] Processing CreateTablet for tablet 070def18cedc4f3f984cb9c74f6f36de (DEFAULT_TABLE table=test-workload [id=ca1a988333314f8d8d59d81b53fb225e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:10.675868 29720 tablet_service.cc:1511] Processing CreateTablet for tablet 070def18cedc4f3f984cb9c74f6f36de (DEFAULT_TABLE table=test-workload [id=ca1a988333314f8d8d59d81b53fb225e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:10.676759 29720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070def18cedc4f3f984cb9c74f6f36de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:10.677326 29566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070def18cedc4f3f984cb9c74f6f36de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:10.677588 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 070def18cedc4f3f984cb9c74f6f36de (DEFAULT_TABLE table=test-workload [id=ca1a988333314f8d8d59d81b53fb225e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:10.678378 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070def18cedc4f3f984cb9c74f6f36de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:10.683667 30273 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Bootstrap starting.
I20260812 06:36:10.684297 30271 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: Bootstrap starting.
I20260812 06:36:10.685899 30273 tablet_bootstrap.cc:654] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:10.686435 30275 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: Bootstrap starting.
I20260812 06:36:10.686444 30271 tablet_bootstrap.cc:654] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:10.687273 30271 log.cc:826] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:10.687426 30273 log.cc:826] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:10.688054 30272 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Bootstrap starting.
I20260812 06:36:10.688539 30275 tablet_bootstrap.cc:654] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:10.689155 30275 log.cc:826] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:10.689649 30273 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: No bootstrap required, opened a new log
I20260812 06:36:10.689831 30273 ts_tablet_manager.cc:1403] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 06:36:10.690086 30272 tablet_bootstrap.cc:654] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:10.690552 30275 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: No bootstrap required, opened a new log
I20260812 06:36:10.690676 30275 ts_tablet_manager.cc:1403] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:36:10.690807 30272 log.cc:826] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:10.692112 30271 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: No bootstrap required, opened a new log
I20260812 06:36:10.693006 30275 raft_consensus.cc:359] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.693225 30275 raft_consensus.cc:740] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82513f07430b4c738a10ab3c947c287e, State: Initialized, Role: FOLLOWER
I20260812 06:36:10.693578 30272 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: No bootstrap required, opened a new log
I20260812 06:36:10.693473 30273 raft_consensus.cc:359] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.693559 30275 consensus_queue.cc:260] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.693717 30273 raft_consensus.cc:740] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f65f848bd434ee2848b711bb1410d89, State: Initialized, Role: FOLLOWER
I20260812 06:36:10.693914 30272 ts_tablet_manager.cc:1403] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:10.694007 30273 consensus_queue.cc:260] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.694419 29792 heartbeater.cc:499] Master 127.28.177.190:41649 was elected leader, sending a full tablet report...
I20260812 06:36:10.694868 30273 ts_tablet_manager.cc:1434] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:10.695221 30238 heartbeater.cc:499] Master 127.28.177.190:41649 was elected leader, sending a full tablet report...
I20260812 06:36:10.694415 30275 ts_tablet_manager.cc:1434] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 06:36:10.696341 30274 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: Bootstrap starting.
I20260812 06:36:10.697217 30272 raft_consensus.cc:359] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.697444 30272 raft_consensus.cc:740] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d05be7f5a94ec3a387e1deb46148dc, State: Initialized, Role: FOLLOWER
I20260812 06:36:10.697719 30272 consensus_queue.cc:260] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.698378 29647 heartbeater.cc:499] Master 127.28.177.190:41649 was elected leader, sending a full tablet report...
I20260812 06:36:10.698370 30274 tablet_bootstrap.cc:654] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:10.699236 30274 log.cc:826] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:10.699589 30272 ts_tablet_manager.cc:1434] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:10.699662 30271 ts_tablet_manager.cc:1403] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.001s
I20260812 06:36:10.703311 30274 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: No bootstrap required, opened a new log
I20260812 06:36:10.703380 30271 raft_consensus.cc:359] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.703547 30274 ts_tablet_manager.cc:1403] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: Time spent bootstrapping tablet: real 0.009s	user 0.005s	sys 0.000s
I20260812 06:36:10.703608 30271 raft_consensus.cc:740] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e93c5425e1e44a2a9286835d4ec70b4b, State: Initialized, Role: FOLLOWER
I20260812 06:36:10.703864 30271 consensus_queue.cc:260] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.704489 29941 heartbeater.cc:499] Master 127.28.177.190:41649 was elected leader, sending a full tablet report...
I20260812 06:36:10.705565 30271 ts_tablet_manager.cc:1434] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260812 06:36:10.706583 30274 raft_consensus.cc:359] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.706795 30274 raft_consensus.cc:740] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bed2803762b49ef87fcdb78cdc2de08, State: Initialized, Role: FOLLOWER
I20260812 06:36:10.707070 30274 consensus_queue.cc:260] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.707873 30092 heartbeater.cc:499] Master 127.28.177.190:41649 was elected leader, sending a full tablet report...
I20260812 06:36:10.707968 30274 ts_tablet_manager.cc:1434] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:10.731055 29590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "070def18cedc4f3f984cb9c74f6f36de"
dest_uuid: "03d05be7f5a94ec3a387e1deb46148dc"
 from {username='slave'} at 127.0.0.1:34646
I20260812 06:36:10.731299 29590 raft_consensus.cc:493] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:10.731472 29590 raft_consensus.cc:3060] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:10.732512 29590 raft_consensus.cc:515] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.733665 29590 leader_election.cc:290] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [CANDIDATE]: Term 1 election: Requested vote from peers e93c5425e1e44a2a9286835d4ec70b4b (127.28.177.131:46289), 2bed2803762b49ef87fcdb78cdc2de08 (127.28.177.132:46173), 82513f07430b4c738a10ab3c947c287e (127.28.177.130:42801), 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133:34967)
I20260812 06:36:10.738761 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070def18cedc4f3f984cb9c74f6f36de" candidate_uuid: "03d05be7f5a94ec3a387e1deb46148dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e93c5425e1e44a2a9286835d4ec70b4b"
I20260812 06:36:10.738843 30040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070def18cedc4f3f984cb9c74f6f36de" candidate_uuid: "03d05be7f5a94ec3a387e1deb46148dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2bed2803762b49ef87fcdb78cdc2de08"
I20260812 06:36:10.738971 29885 raft_consensus.cc:3060] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:10.739029 30040 raft_consensus.cc:3060] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:10.740042 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0 0.0 0.0
I20260812 06:36:10.740221 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070def18cedc4f3f984cb9c74f6f36de" candidate_uuid: "03d05be7f5a94ec3a387e1deb46148dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "82513f07430b4c738a10ab3c947c287e"
I20260812 06:36:10.740267 30040 raft_consensus.cc:2468] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d05be7f5a94ec3a387e1deb46148dc in term 1.
I20260812 06:36:10.740269 29885 raft_consensus.cc:2468] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d05be7f5a94ec3a387e1deb46148dc in term 1.
I20260812 06:36:10.740396 29744 raft_consensus.cc:3060] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:10.740715 29516 leader_election.cc:304] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 03d05be7f5a94ec3a387e1deb46148dc, 2bed2803762b49ef87fcdb78cdc2de08, e93c5425e1e44a2a9286835d4ec70b4b; no voters: 
I20260812 06:36:10.740983 30283 raft_consensus.cc:2804] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:10.741252 30283 raft_consensus.cc:697] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 1 LEADER]: Becoming Leader. State: Replica: 03d05be7f5a94ec3a387e1deb46148dc, State: Running, Role: LEADER
I20260812 06:36:10.741480 29744 raft_consensus.cc:2468] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d05be7f5a94ec3a387e1deb46148dc in term 1.
I20260812 06:36:10.741626 30283 consensus_queue.cc:237] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:10.742679 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070def18cedc4f3f984cb9c74f6f36de" candidate_uuid: "03d05be7f5a94ec3a387e1deb46148dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5f65f848bd434ee2848b711bb1410d89"
I20260812 06:36:10.742884 30187 raft_consensus.cc:3060] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:10.743831 30187 raft_consensus.cc:2468] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d05be7f5a94ec3a387e1deb46148dc in term 1.
I20260812 06:36:10.745325 29425 catalog_manager.cc:5719] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 03d05be7f5a94ec3a387e1deb46148dc (127.28.177.129). New cstate: current_term: 1 leader_uuid: "03d05be7f5a94ec3a387e1deb46148dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:10.777455 29942 tablet.cc:2406] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:10.844677 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1 0.0 0.0
W20260812 06:36:10.852742 29793 tablet.cc:2406] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:10.856981 30241 tablet.cc:2406] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:10.912631 29648 tablet.cc:2406] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:10.942777 30093 tablet.cc:2406] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:11.048971 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1 0.0 0.0
I20260812 06:36:11.126456 30283 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:11.209755 30283 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:11.215601 30303 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:11.215961 30302 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:11.355346 29590 consensus_queue.cc:237] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:11.356902 29744 raft_consensus.cc:1275] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [term 1 FOLLOWER]: Refusing update from remote peer 03d05be7f5a94ec3a387e1deb46148dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:11.357021 29885 raft_consensus.cc:1275] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [term 1 FOLLOWER]: Refusing update from remote peer 03d05be7f5a94ec3a387e1deb46148dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:11.357004 30040 raft_consensus.cc:1275] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [term 1 FOLLOWER]: Refusing update from remote peer 03d05be7f5a94ec3a387e1deb46148dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:11.357402 30283 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:36:11.357537 30303 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:36:11.357702 30302 consensus_queue.cc:1048] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:36:11.359763 30302 raft_consensus.cc:2955] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } }
I20260812 06:36:11.360303 29885 raft_consensus.cc:2955] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } }
I20260812 06:36:11.360793 30040 raft_consensus.cc:2955] T 070def18cedc4f3f984cb9c74f6f36de P 2bed2803762b49ef87fcdb78cdc2de08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } }
I20260812 06:36:11.363011 29744 raft_consensus.cc:2955] T 070def18cedc4f3f984cb9c74f6f36de P 82513f07430b4c738a10ab3c947c287e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } }
I20260812 06:36:11.363317 29423 catalog_manager.cc:5719] T 070def18cedc4f3f984cb9c74f6f36de P e93c5425e1e44a2a9286835d4ec70b4b reported cstate change: config changed from index -1 to 2, VOTER 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133) evicted. New cstate: current_term: 1 leader_uuid: "03d05be7f5a94ec3a387e1deb46148dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } }
I20260812 06:36:11.366693 30165 tablet_service.cc:1558] Processing DeleteTablet for tablet 070def18cedc4f3f984cb9c74f6f36de with delete_type TABLET_DATA_TOMBSTONED (TS 5f65f848bd434ee2848b711bb1410d89 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:57116
I20260812 06:36:11.367245 30318 tablet_replica.cc:333] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: stopping tablet replica
I20260812 06:36:11.367542 30318 raft_consensus.cc:2243] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:11.367791 30318 raft_consensus.cc:2272] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:11.369067 30318 ts_tablet_manager.cc:1916] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:11.370872 30318 ts_tablet_manager.cc:1929] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 06:36:11.370942 30318 log.cc:1199] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Deleting WAL directory at /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786516569449997-29382-0/minicluster-data/ts-4/wal/wals/070def18cedc4f3f984cb9c74f6f36de
I20260812 06:36:11.371474 29410 catalog_manager.cc:5050] TS 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133:34967): tablet 070def18cedc4f3f984cb9c74f6f36de (table test-workload [id=ca1a988333314f8d8d59d81b53fb225e]) successfully deleted
I20260812 06:36:11.375078 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 29650
I20260812 06:36:11.385251 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 29795
I20260812 06:36:11.394438 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 29944
I20260812 06:36:11.404553 29590 consensus_queue.cc:237] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } attrs { } }
W20260812 06:36:11.406505 29516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.132:46173: connect: Connection refused (error 111)
W20260812 06:36:11.407092 29518 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 5f65f848bd434ee2848b711bb1410d89 (127.28.177.133:34967): Couldn't send request to peer 5f65f848bd434ee2848b711bb1410d89. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:11.407604 29518 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 82513f07430b4c738a10ab3c947c287e (127.28.177.130:42801): Couldn't send request to peer 82513f07430b4c738a10ab3c947c287e. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:42801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:11.407618 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 2bed2803762b49ef87fcdb78cdc2de08 (127.28.177.132:46173): Couldn't send request to peer 2bed2803762b49ef87fcdb78cdc2de08. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:46173: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:11.407769 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer e93c5425e1e44a2a9286835d4ec70b4b (127.28.177.131:46289): Couldn't send request to peer e93c5425e1e44a2a9286835d4ec70b4b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:46289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:11.810573 30323 ts_tablet_manager.cc:933] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Initiating tablet copy from peer 03d05be7f5a94ec3a387e1deb46148dc (127.28.177.129:34795)
I20260812 06:36:11.811304 30323 tablet_copy_client.cc:323] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: tablet copy: Beginning tablet copy session from remote peer at address 127.28.177.129:34795
I20260812 06:36:11.815119 29615 tablet_copy_service.cc:140] P 03d05be7f5a94ec3a387e1deb46148dc: Received BeginTabletCopySession request for tablet 070def18cedc4f3f984cb9c74f6f36de from peer 5f65f848bd434ee2848b711bb1410d89 ({username='slave'} at 127.28.177.133:58037)
I20260812 06:36:11.815263 29615 tablet_copy_service.cc:161] P 03d05be7f5a94ec3a387e1deb46148dc: Beginning new tablet copy session on tablet 070def18cedc4f3f984cb9c74f6f36de from peer 5f65f848bd434ee2848b711bb1410d89 at {username='slave'} at 127.28.177.133:58037: session id = 5f65f848bd434ee2848b711bb1410d89-070def18cedc4f3f984cb9c74f6f36de
I20260812 06:36:11.816574 29615 tablet_copy_source_session.cc:215] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:11.817917 30323 ts_tablet_manager.cc:1916] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:11.819867 30323 ts_tablet_manager.cc:1929] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260812 06:36:11.820079 30323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070def18cedc4f3f984cb9c74f6f36de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:11.821099 30323 tablet_copy_client.cc:806] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:11.821281 30323 tablet_copy_client.cc:670] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:11.823012 30323 tablet_copy_client.cc:538] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:11.824321 30323 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Bootstrap starting.
I20260812 06:36:11.828569 30323 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:36:11.828892 30323 tablet_bootstrap.cc:492] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Bootstrap complete.
I20260812 06:36:11.829059 30323 ts_tablet_manager.cc:1403] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.001s
I20260812 06:36:11.829572 30323 raft_consensus.cc:359] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } }
I20260812 06:36:11.829849 30323 raft_consensus.cc:740] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f65f848bd434ee2848b711bb1410d89, State: Initialized, Role: FOLLOWER
I20260812 06:36:11.829986 30323 consensus_queue.cc:260] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e93c5425e1e44a2a9286835d4ec70b4b" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 46289 } } peers { permanent_uuid: "2bed2803762b49ef87fcdb78cdc2de08" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46173 } } peers { permanent_uuid: "82513f07430b4c738a10ab3c947c287e" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 42801 } } peers { permanent_uuid: "03d05be7f5a94ec3a387e1deb46148dc" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34795 } } peers { permanent_uuid: "5f65f848bd434ee2848b711bb1410d89" member_type: VOTER last_known_addr { host: "127.28.177.133" port: 34967 } attrs { } }
I20260812 06:36:11.830375 30323 ts_tablet_manager.cc:1434] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.002s
I20260812 06:36:11.831095 29615 tablet_copy_service.cc:342] P 03d05be7f5a94ec3a387e1deb46148dc: Request end of tablet copy session 5f65f848bd434ee2848b711bb1410d89-070def18cedc4f3f984cb9c74f6f36de received from {username='slave'} at 127.28.177.133:58037
I20260812 06:36:11.831208 29615 tablet_copy_service.cc:434] P 03d05be7f5a94ec3a387e1deb46148dc: ending tablet copy session 5f65f848bd434ee2848b711bb1410d89-070def18cedc4f3f984cb9c74f6f36de on tablet 070def18cedc4f3f984cb9c74f6f36de with peer 5f65f848bd434ee2848b711bb1410d89
I20260812 06:36:12.242468 30187 raft_consensus.cc:1217] T 070def18cedc4f3f984cb9c74f6f36de P 5f65f848bd434ee2848b711bb1410d89 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3]   Dedup: 1.3->[]
W20260812 06:36:13.694530 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer e93c5425e1e44a2a9286835d4ec70b4b (127.28.177.131:46289): Couldn't send request to peer e93c5425e1e44a2a9286835d4ec70b4b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:46289: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:13.909243 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 2bed2803762b49ef87fcdb78cdc2de08 (127.28.177.132:46173): Couldn't send request to peer 2bed2803762b49ef87fcdb78cdc2de08. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:46173: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:14.122884 29518 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 82513f07430b4c738a10ab3c947c287e (127.28.177.130:42801): Couldn't send request to peer 82513f07430b4c738a10ab3c947c287e. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:42801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:16.082163 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer e93c5425e1e44a2a9286835d4ec70b4b (127.28.177.131:46289): Couldn't send request to peer e93c5425e1e44a2a9286835d4ec70b4b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:46289: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:36:16.406484 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 2bed2803762b49ef87fcdb78cdc2de08 (127.28.177.132:46173): Couldn't send request to peer 2bed2803762b49ef87fcdb78cdc2de08. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:46173: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:36:16.623601 29516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.131:46289: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20260812 06:36:16.624782 29518 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 82513f07430b4c738a10ab3c947c287e (127.28.177.130:42801): Couldn't send request to peer 82513f07430b4c738a10ab3c947c287e. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:42801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:36:18.854971 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer e93c5425e1e44a2a9286835d4ec70b4b (127.28.177.131:46289): Couldn't send request to peer e93c5425e1e44a2a9286835d4ec70b4b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:46289: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:36:18.880831 29516 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 2bed2803762b49ef87fcdb78cdc2de08 (127.28.177.132:46173): Couldn't send request to peer 2bed2803762b49ef87fcdb78cdc2de08. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:46173: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:36:19.159550 29518 consensus_peers.cc:597] T 070def18cedc4f3f984cb9c74f6f36de P 03d05be7f5a94ec3a387e1deb46148dc -> Peer 82513f07430b4c738a10ab3c947c287e (127.28.177.130:42801): Couldn't send request to peer 82513f07430b4c738a10ab3c947c287e. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:42801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 06:36:19.409499 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 29497
I20260812 06:36:19.420208 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 30095
I20260812 06:36:19.429028 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 29392
2026-08-12T06:36:19Z chronyd exiting
[       OK ] TabletReplacementITest.TestMasterTombstoneEvictedReplica (9994 ms)
[ RUN      ] TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport
2026-08-12T06:36:19Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:19Z Disabled control of system clock
I20260812 06:36:19.463953 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:46113
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:46113
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 06:36:19.565881 30336 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:19.566075 30336 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:19.566120 30336 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:19.569387 30336 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:19.569443 30336 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:19.569463 30336 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:19.569481 30336 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:19.573143 30336 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:46113
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:46113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.30336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:19.574086 30336 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:19.575138 30336 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:19.580685 30343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:19.580677 30346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:19.580746 30336 server_base.cc:1061] running on GCE node
W20260812 06:36:19.580677 30344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:19.581454 30336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:19.582301 30336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:19.583460 30336 hybrid_clock.cc:648] HybridClock initialized: now 1786516579583443 us; error 30 us; skew 500 ppm
I20260812 06:36:19.585151 30336 webserver.cc:533] Webserver started at http://127.28.177.190:43979/ using document root <none> and password file <none>
I20260812 06:36:19.585685 30336 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:19.585738 30336 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:19.585894 30336 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:19.587373 30336 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "e122662109024e9ba0747332f5791ac8"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.587795 30336 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "e122662109024e9ba0747332f5791ac8"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.591012 30336 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:19.593065 30354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.594034 30336 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:19.594183 30336 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "e122662109024e9ba0747332f5791ac8"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.594306 30336 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:19.603607 30336 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:19.604283 30336 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:19.604475 30336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:19.611579 30410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:46113 every 8 connection(s)
I20260812 06:36:19.611588 30336 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:46113
I20260812 06:36:19.612618 30336 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:19.615504 30411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:19.619413 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 30336
I20260812 06:36:19.619503 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:19.620787 30411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Bootstrap starting.
I20260812 06:36:19.623525 30411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:19.624468 30411 log.cc:826] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:19.626360 30411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: No bootstrap required, opened a new log
I20260812 06:36:19.629434 30411 raft_consensus.cc:359] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:19.629617 30411 raft_consensus.cc:385] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:19.629657 30411 raft_consensus.cc:740] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e122662109024e9ba0747332f5791ac8, State: Initialized, Role: FOLLOWER
I20260812 06:36:19.629995 30411 consensus_queue.cc:260] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:19.630115 30411 raft_consensus.cc:399] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:19.630162 30411 raft_consensus.cc:493] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:19.630244 30411 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:19.630987 30411 raft_consensus.cc:515] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:19.631305 30411 leader_election.cc:304] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e122662109024e9ba0747332f5791ac8; no voters: 
I20260812 06:36:19.631567 30411 leader_election.cc:290] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:19.631698 30416 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:19.631929 30416 raft_consensus.cc:697] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 LEADER]: Becoming Leader. State: Replica: e122662109024e9ba0747332f5791ac8, State: Running, Role: LEADER
I20260812 06:36:19.632301 30416 consensus_queue.cc:237] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:19.632807 30411 sys_catalog.cc:565] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:19.633950 30418 sys_catalog.cc:455] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e122662109024e9ba0747332f5791ac8. Latest consensus state: current_term: 1 leader_uuid: "e122662109024e9ba0747332f5791ac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } } }
I20260812 06:36:19.633992 30417 sys_catalog.cc:455] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e122662109024e9ba0747332f5791ac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } } }
I20260812 06:36:19.634074 30418 sys_catalog.cc:458] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:19.634104 30417 sys_catalog.cc:458] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:19.635296 30426 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:19.638134 30426 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:19.643055 30426 catalog_manager.cc:1383] Generated new cluster ID: e96d45e8ba544baea88b8b4e8ffd546d
I20260812 06:36:19.643136 30426 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:19.665544 30426 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:19.666426 30426 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:19.671952 30426 catalog_manager.cc:6092] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Generated new TSK 0
I20260812 06:36:19.672531 30426 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:19.675160 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
W20260812 06:36:19.782147 30440 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:19.782361 30440 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:19.782404 30440 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:19.785878 30440 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:19.785983 30440 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:19.789886 30440 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--never_fsync=true
--heap_profile_path=/tmp/kudu.30440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:19.791059 30440 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:19.792289 30440 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:19.798635 30445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:19.798667 30448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:19.799031 30440 server_base.cc:1061] running on GCE node
W20260812 06:36:19.798738 30446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:19.799423 30440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:19.799939 30440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:19.801085 30440 hybrid_clock.cc:648] HybridClock initialized: now 1786516579801064 us; error 33 us; skew 500 ppm
I20260812 06:36:19.802788 30440 webserver.cc:533] Webserver started at http://127.28.177.129:33525/ using document root <none> and password file <none>
I20260812 06:36:19.803365 30440 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:19.803421 30440 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:19.803624 30440 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:19.805207 30440 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "a2bd9243fbf64361bff1e92c11442e48"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.805742 30440 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "a2bd9243fbf64361bff1e92c11442e48"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.809026 30440 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:19.811084 30455 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.812004 30440 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:19.812153 30440 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "a2bd9243fbf64361bff1e92c11442e48"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.812299 30440 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:19.843077 30440 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:19.843807 30440 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:19.844013 30440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:19.844687 30440 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:19.845736 30440 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:19.845830 30440 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.845901 30440 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:19.845952 30440 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.855625 30440 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:39251
I20260812 06:36:19.855662 30596 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:39251 every 8 connection(s)
I20260812 06:36:19.856684 30440 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:19.861682 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 30440
I20260812 06:36:19.861833 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:19.864271 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
I20260812 06:36:19.866006 30597 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:19.866269 30597 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:19.866888 30597 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:19.868489 30373 ts_manager.cc:194] Registered new tserver with Master: a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129:39251)
I20260812 06:36:19.869627 30373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:52117
W20260812 06:36:19.970496 30600 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:19.970732 30600 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:19.970809 30600 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:19.974059 30600 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:19.974241 30600 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:19.977967 30600 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--never_fsync=true
--heap_profile_path=/tmp/kudu.30600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:19.979027 30600 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:19.980306 30600 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:19.986727 30605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:19.986747 30606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:19.986735 30608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:19.987026 30600 server_base.cc:1061] running on GCE node
I20260812 06:36:19.987357 30600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:19.987924 30600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:19.989085 30600 hybrid_clock.cc:648] HybridClock initialized: now 1786516579989069 us; error 28 us; skew 500 ppm
I20260812 06:36:19.990842 30600 webserver.cc:533] Webserver started at http://127.28.177.130:33143/ using document root <none> and password file <none>
I20260812 06:36:19.991366 30600 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:19.991420 30600 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:19.991577 30600 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:19.993117 30600 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "f3bbc9d57e1d4a90893192ce9d819127"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.993549 30600 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "f3bbc9d57e1d4a90893192ce9d819127"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:19.996740 30600 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:19.999033 30617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.000032 30600 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 06:36:20.000191 30600 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "f3bbc9d57e1d4a90893192ce9d819127"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:20.000290 30600 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:20.016950 30600 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:20.017508 30600 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:20.017663 30600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:20.018184 30600 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:20.019186 30600 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:20.019236 30600 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.019315 30600 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:20.019359 30600 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.028992 30600 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:46181
I20260812 06:36:20.029019 30743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:46181 every 8 connection(s)
I20260812 06:36:20.029989 30600 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:20.030810 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 30600
I20260812 06:36:20.030901 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:20.033504 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
I20260812 06:36:20.040639 30744 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:20.040869 30744 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:20.041354 30744 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:20.042420 30373 ts_manager.cc:194] Registered new tserver with Master: f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181)
I20260812 06:36:20.042973 30373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:39667
W20260812 06:36:20.142346 30747 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:20.142580 30747 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:20.142661 30747 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:20.146003 30747 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:20.146159 30747 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:20.150053 30747 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--never_fsync=true
--heap_profile_path=/tmp/kudu.30747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:20.151160 30747 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:20.152433 30747 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:20.158797 30753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:20.158820 30754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:20.158797 30757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:20.158924 30747 server_base.cc:1061] running on GCE node
I20260812 06:36:20.159385 30747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:20.160032 30747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:20.161216 30747 hybrid_clock.cc:648] HybridClock initialized: now 1786516580161196 us; error 31 us; skew 500 ppm
I20260812 06:36:20.162915 30747 webserver.cc:533] Webserver started at http://127.28.177.131:37451/ using document root <none> and password file <none>
I20260812 06:36:20.163498 30747 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:20.163583 30747 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:20.163796 30747 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:20.165417 30747 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf"
format_stamp: "Formatted at 2026-08-12 06:36:20 on dist-test-slave-cbbz"
I20260812 06:36:20.165921 30747 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf"
format_stamp: "Formatted at 2026-08-12 06:36:20 on dist-test-slave-cbbz"
I20260812 06:36:20.169292 30747 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:20.171531 30763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.172626 30747 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:20.172772 30747 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf"
format_stamp: "Formatted at 2026-08-12 06:36:20 on dist-test-slave-cbbz"
I20260812 06:36:20.172876 30747 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:20.193564 30747 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:20.194200 30747 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:20.194409 30747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:20.194977 30747 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:20.196007 30747 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:20.196081 30747 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.196148 30747 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:20.196230 30747 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.205761 30747 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:33435
I20260812 06:36:20.205806 30899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:33435 every 8 connection(s)
I20260812 06:36:20.206688 30747 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:20.210580 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 30747
I20260812 06:36:20.210700 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:20.212865 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.132:0
--local_ip_for_outbound_sockets=127.28.177.132
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
I20260812 06:36:20.215575 30900 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:20.215827 30900 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:20.216485 30900 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:20.217608 30373 ts_manager.cc:194] Registered new tserver with Master: 80feb1fbc0c14ce7b75b5cba3c3a0baf (127.28.177.131:33435)
I20260812 06:36:20.218442 30373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:41487
W20260812 06:36:20.317536 30903 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:20.317730 30903 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:20.317770 30903 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:20.320986 30903 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:20.321075 30903 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.132
I20260812 06:36:20.324893 30903 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:46113
--never_fsync=true
--heap_profile_path=/tmp/kudu.30903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:20.325819 30903 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:20.326833 30903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:20.333639 30915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:20.333640 30910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:20.334074 30913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:20.334067 30903 server_base.cc:1061] running on GCE node
I20260812 06:36:20.334511 30903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:20.335171 30903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:20.336333 30903 hybrid_clock.cc:648] HybridClock initialized: now 1786516580336315 us; error 37 us; skew 500 ppm
I20260812 06:36:20.338071 30903 webserver.cc:533] Webserver started at http://127.28.177.132:35067/ using document root <none> and password file <none>
I20260812 06:36:20.338662 30903 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:20.338747 30903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:20.338967 30903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:20.340539 30903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data/instance:
uuid: "fa21491bb53a405da48db4f2ce0cb670"
format_stamp: "Formatted at 2026-08-12 06:36:20 on dist-test-slave-cbbz"
I20260812 06:36:20.341012 30903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance:
uuid: "fa21491bb53a405da48db4f2ce0cb670"
format_stamp: "Formatted at 2026-08-12 06:36:20 on dist-test-slave-cbbz"
I20260812 06:36:20.344121 30903 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:20.346230 30921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.347117 30903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:20.347256 30903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal
uuid: "fa21491bb53a405da48db4f2ce0cb670"
format_stamp: "Formatted at 2026-08-12 06:36:20 on dist-test-slave-cbbz"
I20260812 06:36:20.347362 30903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:20.373040 30903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:20.373705 30903 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:20.373903 30903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:20.374497 30903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:20.375555 30903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:20.375629 30903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.375700 30903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:20.375751 30903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:20.385170 30903 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.132:44997
I20260812 06:36:20.385202 31058 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.132:44997 every 8 connection(s)
I20260812 06:36:20.386225 30903 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
I20260812 06:36:20.389286 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 30903
I20260812 06:36:20.389406 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance
I20260812 06:36:20.395442 31060 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:20.395643 31060 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:20.396073 31060 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:20.397083 30373 ts_manager.cc:194] Registered new tserver with Master: fa21491bb53a405da48db4f2ce0cb670 (127.28.177.132:44997)
I20260812 06:36:20.397578 30373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.132:46897
I20260812 06:36:20.403550 29382 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:36:20.419553 30373 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53444:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:36:20.436787 30669 tablet_service.cc:1511] Processing CreateTablet for tablet 776e94bec0a442d89b8633bf19fce6eb (DEFAULT_TABLE table=test-workload [id=ff357b13bc104912a7a4d0141714e592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:20.436859 30987 tablet_service.cc:1511] Processing CreateTablet for tablet 776e94bec0a442d89b8633bf19fce6eb (DEFAULT_TABLE table=test-workload [id=ff357b13bc104912a7a4d0141714e592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:20.437044 30819 tablet_service.cc:1511] Processing CreateTablet for tablet 776e94bec0a442d89b8633bf19fce6eb (DEFAULT_TABLE table=test-workload [id=ff357b13bc104912a7a4d0141714e592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:20.437839 30669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e94bec0a442d89b8633bf19fce6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:20.437848 30819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e94bec0a442d89b8633bf19fce6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:20.437848 30987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e94bec0a442d89b8633bf19fce6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:20.442783 31087 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Bootstrap starting.
I20260812 06:36:20.443955 31088 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Bootstrap starting.
I20260812 06:36:20.444473 31089 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: Bootstrap starting.
I20260812 06:36:20.445127 31087 tablet_bootstrap.cc:654] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:20.445972 31087 log.cc:826] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:20.446173 31088 tablet_bootstrap.cc:654] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:20.446579 31089 tablet_bootstrap.cc:654] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:20.447027 31088 log.cc:826] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:20.447305 31089 log.cc:826] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:20.447799 31087 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: No bootstrap required, opened a new log
I20260812 06:36:20.447989 31087 ts_tablet_manager.cc:1403] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:20.448750 31088 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: No bootstrap required, opened a new log
I20260812 06:36:20.448918 31089 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: No bootstrap required, opened a new log
I20260812 06:36:20.448930 31088 ts_tablet_manager.cc:1403] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:20.449120 31089 ts_tablet_manager.cc:1403] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:20.451191 31087 raft_consensus.cc:359] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.451297 31089 raft_consensus.cc:359] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.451498 31087 raft_consensus.cc:385] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:20.451593 31089 raft_consensus.cc:385] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:20.451609 31087 raft_consensus.cc:740] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3bbc9d57e1d4a90893192ce9d819127, State: Initialized, Role: FOLLOWER
I20260812 06:36:20.451741 31089 raft_consensus.cc:740] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80feb1fbc0c14ce7b75b5cba3c3a0baf, State: Initialized, Role: FOLLOWER
I20260812 06:36:20.451860 31088 raft_consensus.cc:359] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.452167 31088 raft_consensus.cc:385] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:20.452289 31088 raft_consensus.cc:740] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa21491bb53a405da48db4f2ce0cb670, State: Initialized, Role: FOLLOWER
I20260812 06:36:20.452241 31089 consensus_queue.cc:260] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.452261 31087 consensus_queue.cc:260] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.452718 31088 consensus_queue.cc:260] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.453142 31087 ts_tablet_manager.cc:1434] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:20.453142 31089 ts_tablet_manager.cc:1434] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 06:36:20.453428 31060 heartbeater.cc:499] Master 127.28.177.190:46113 was elected leader, sending a full tablet report...
I20260812 06:36:20.453504 31088 ts_tablet_manager.cc:1434] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:20.453527 30744 heartbeater.cc:499] Master 127.28.177.190:46113 was elected leader, sending a full tablet report...
I20260812 06:36:20.454500 30900 heartbeater.cc:499] Master 127.28.177.190:46113 was elected leader, sending a full tablet report...
I20260812 06:36:20.456907 31096 raft_consensus.cc:493] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:20.457131 31096 raft_consensus.cc:515] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
W20260812 06:36:20.457535 30901 tablet.cc:2406] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:20.459012 31096 leader_election.cc:290] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181), 80feb1fbc0c14ce7b75b5cba3c3a0baf (127.28.177.131:33435)
I20260812 06:36:20.462430 30693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e94bec0a442d89b8633bf19fce6eb" candidate_uuid: "fa21491bb53a405da48db4f2ce0cb670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3bbc9d57e1d4a90893192ce9d819127" is_pre_election: true
I20260812 06:36:20.462659 30693 raft_consensus.cc:2468] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21491bb53a405da48db4f2ce0cb670 in term 0.
I20260812 06:36:20.463179 30926 leader_election.cc:304] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f3bbc9d57e1d4a90893192ce9d819127, fa21491bb53a405da48db4f2ce0cb670; no voters: 
I20260812 06:36:20.463215 30845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e94bec0a442d89b8633bf19fce6eb" candidate_uuid: "fa21491bb53a405da48db4f2ce0cb670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" is_pre_election: true
I20260812 06:36:20.463423 30845 raft_consensus.cc:2468] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa21491bb53a405da48db4f2ce0cb670 in term 0.
I20260812 06:36:20.463474 31096 raft_consensus.cc:2804] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:20.463605 31096 raft_consensus.cc:493] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:20.463670 31096 raft_consensus.cc:3060] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:20.464601 31096 raft_consensus.cc:515] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.464949 31096 leader_election.cc:290] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [CANDIDATE]: Term 1 election: Requested vote from peers f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181), 80feb1fbc0c14ce7b75b5cba3c3a0baf (127.28.177.131:33435)
I20260812 06:36:20.465304 30845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e94bec0a442d89b8633bf19fce6eb" candidate_uuid: "fa21491bb53a405da48db4f2ce0cb670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf"
I20260812 06:36:20.465304 30693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776e94bec0a442d89b8633bf19fce6eb" candidate_uuid: "fa21491bb53a405da48db4f2ce0cb670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3bbc9d57e1d4a90893192ce9d819127"
I20260812 06:36:20.465427 30845 raft_consensus.cc:3060] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:20.465430 30693 raft_consensus.cc:3060] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:20.466570 30845 raft_consensus.cc:2468] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21491bb53a405da48db4f2ce0cb670 in term 1.
I20260812 06:36:20.466922 30923 leader_election.cc:304] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80feb1fbc0c14ce7b75b5cba3c3a0baf, fa21491bb53a405da48db4f2ce0cb670; no voters: 
I20260812 06:36:20.467026 30693 raft_consensus.cc:2468] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa21491bb53a405da48db4f2ce0cb670 in term 1.
I20260812 06:36:20.467180 31096 raft_consensus.cc:2804] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:20.467425 31096 raft_consensus.cc:697] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 1 LEADER]: Becoming Leader. State: Replica: fa21491bb53a405da48db4f2ce0cb670, State: Running, Role: LEADER
I20260812 06:36:20.467722 31096 consensus_queue.cc:237] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } }
I20260812 06:36:20.470328 30371 catalog_manager.cc:5719] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa21491bb53a405da48db4f2ce0cb670 (127.28.177.132). New cstate: current_term: 1 leader_uuid: "fa21491bb53a405da48db4f2ce0cb670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:20.493462 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 30600
W20260812 06:36:20.637111 31061 tablet.cc:2406] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:20.854460 31096 consensus_queue.cc:1048] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:36:20.861295 30926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:46181: connect: Connection refused (error 111)
W20260812 06:36:20.862300 30926 consensus_peers.cc:597] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 -> Peer f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): Couldn't send request to peer f3bbc9d57e1d4a90893192ce9d819127. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:20.872061 30597 heartbeater.cc:499] Master 127.28.177.190:46113 was elected leader, sending a full tablet report...
W20260812 06:36:23.010704 30926 consensus_peers.cc:597] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 -> Peer f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): Couldn't send request to peer f3bbc9d57e1d4a90893192ce9d819127. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:46181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 06:36:25.499310 31111 consensus_queue.cc:579] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Leader has been unable to successfully communicate with peer f3bbc9d57e1d4a90893192ce9d819127 for more than 5 seconds (5.031s)
W20260812 06:36:25.500996 30926 consensus_peers.cc:597] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 -> Peer f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): Couldn't send request to peer f3bbc9d57e1d4a90893192ce9d819127. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:46181: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 06:36:25.503557 31009 consensus_queue.cc:237] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: NON_VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: true } }
I20260812 06:36:25.505681 30845 raft_consensus.cc:1275] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Refusing update from remote peer fa21491bb53a405da48db4f2ce0cb670: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:25.506214 31111 consensus_queue.cc:1048] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 06:36:25.506378 30926 consensus_peers.cc:597] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 -> Peer f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): Couldn't send request to peer f3bbc9d57e1d4a90893192ce9d819127. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:46181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:25.508276 31117 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: NON_VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: true } } }
I20260812 06:36:25.508792 30845 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: NON_VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: true } } }
I20260812 06:36:25.510601 30356 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 776e94bec0a442d89b8633bf19fce6eb with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20260812 06:36:25.510937 30928 consensus_peers.cc:597] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 -> Peer a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129:39251): Couldn't send request to peer a2bd9243fbf64361bff1e92c11442e48. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 776e94bec0a442d89b8633bf19fce6eb. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:25.511209 30371 catalog_manager.cc:5719] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 reported cstate change: config changed from index -1 to 2, NON_VOTER a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) added. New cstate: current_term: 1 leader_uuid: "fa21491bb53a405da48db4f2ce0cb670" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: NON_VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:25.919480 31130 ts_tablet_manager.cc:933] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Initiating tablet copy from peer fa21491bb53a405da48db4f2ce0cb670 (127.28.177.132:44997)
I20260812 06:36:25.920249 31130 tablet_copy_client.cc:323] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: tablet copy: Beginning tablet copy session from remote peer at address 127.28.177.132:44997
I20260812 06:36:25.924237 31030 tablet_copy_service.cc:140] P fa21491bb53a405da48db4f2ce0cb670: Received BeginTabletCopySession request for tablet 776e94bec0a442d89b8633bf19fce6eb from peer a2bd9243fbf64361bff1e92c11442e48 ({username='slave'} at 127.28.177.129:44209)
I20260812 06:36:25.924427 31030 tablet_copy_service.cc:161] P fa21491bb53a405da48db4f2ce0cb670: Beginning new tablet copy session on tablet 776e94bec0a442d89b8633bf19fce6eb from peer a2bd9243fbf64361bff1e92c11442e48 at {username='slave'} at 127.28.177.129:44209: session id = a2bd9243fbf64361bff1e92c11442e48-776e94bec0a442d89b8633bf19fce6eb
I20260812 06:36:25.925675 31030 tablet_copy_source_session.cc:215] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:25.929127 31130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776e94bec0a442d89b8633bf19fce6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:25.933593 31130 tablet_copy_client.cc:806] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:25.933838 31130 tablet_copy_client.cc:670] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:25.935559 31130 tablet_copy_client.cc:538] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:25.937125 31130 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Bootstrap starting.
I20260812 06:36:25.941744 31130 log.cc:826] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:25.943972 31130 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:25.944280 31130 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Bootstrap complete.
I20260812 06:36:25.944525 31130 ts_tablet_manager.cc:1403] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Time spent bootstrapping tablet: real 0.008s	user 0.006s	sys 0.002s
I20260812 06:36:25.946676 31130 raft_consensus.cc:359] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: NON_VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: true } }
I20260812 06:36:25.946882 31130 raft_consensus.cc:740] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a2bd9243fbf64361bff1e92c11442e48, State: Initialized, Role: LEARNER
I20260812 06:36:25.947139 31130 consensus_queue.cc:260] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: NON_VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: true } }
I20260812 06:36:25.947913 31130 ts_tablet_manager.cc:1434] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.002s
I20260812 06:36:25.948760 31030 tablet_copy_service.cc:342] P fa21491bb53a405da48db4f2ce0cb670: Request end of tablet copy session a2bd9243fbf64361bff1e92c11442e48-776e94bec0a442d89b8633bf19fce6eb received from {username='slave'} at 127.28.177.129:44209
I20260812 06:36:25.948876 31030 tablet_copy_service.cc:434] P fa21491bb53a405da48db4f2ce0cb670: ending tablet copy session a2bd9243fbf64361bff1e92c11442e48-776e94bec0a442d89b8633bf19fce6eb on tablet 776e94bec0a442d89b8633bf19fce6eb with peer a2bd9243fbf64361bff1e92c11442e48
I20260812 06:36:25.950212 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:46181
--local_ip_for_outbound_sockets=127.28.177.130
--tserver_master_addrs=127.28.177.190:46113
--webserver_port=33143
--webserver_interface=127.28.177.130
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
W20260812 06:36:26.054800 31137 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:26.055040 31137 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:26.055119 31137 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:26.058449 31137 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:26.058616 31137 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:26.062371 31137 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:46181
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=33143
--tserver_master_addrs=127.28.177.190:46113
--never_fsync=true
--heap_profile_path=/tmp/kudu.31137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:26.063477 31137 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:26.064621 31137 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:26.071151 31146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:26.071148 31143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:26.071233 31144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:26.071379 31137 server_base.cc:1061] running on GCE node
I20260812 06:36:26.071775 31137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:26.072369 31137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:26.073542 31137 hybrid_clock.cc:648] HybridClock initialized: now 1786516586073527 us; error 32 us; skew 500 ppm
I20260812 06:36:26.075218 31137 webserver.cc:533] Webserver started at http://127.28.177.130:33143/ using document root <none> and password file <none>
I20260812 06:36:26.075776 31137 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:26.075878 31137 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:26.079250 31137 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:26.081154 31153 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:26.082119 31137 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:26.082248 31137 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "f3bbc9d57e1d4a90893192ce9d819127"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:26.082612 31137 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:26.096468 31137 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:26.097004 31137 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:26.097194 31137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:26.097721 31137 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:26.098966 31160 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:36:26.102142 31137 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:36:26.102217 31137 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s	user 0.000s	sys 0.000s
I20260812 06:36:26.102310 31137 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:36:26.103729 31137 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:36:26.103797 31137 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:36:26.104120 31160 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Bootstrap starting.
I20260812 06:36:26.115401 31137 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:46181
I20260812 06:36:26.115465 31285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:46181 every 8 connection(s)
I20260812 06:36:26.116540 31137 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:26.119042 31160 log.cc:826] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:26.120404 31160 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:26.120810 31160 tablet_bootstrap.cc:492] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Bootstrap complete.
I20260812 06:36:26.122251 31160 ts_tablet_manager.cc:1403] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
E20260812 06:36:26.125174 31160 ts_tablet_manager.cc:1446] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Tablet failed to start: Corruption: Unable to start RaftConsensus: The last op in the WAL with id 0.0 has a term (0) that is greater than the latest recorded term, which is -1
I20260812 06:36:26.125264 31160 ts_tablet_manager.cc:1434] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:26.125387 31160 tablet_replica.cc:333] stopping tablet replica
I20260812 06:36:26.125551 31160 raft_consensus.cc:2243] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term -1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:26.125926 31160 raft_consensus.cc:2272] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127 [term -1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:26.126789 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 31137
I20260812 06:36:26.129271 31286 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:26.129524 31286 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:26.130025 31286 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:26.131495 30373 ts_manager.cc:194] Re-registered known tserver with Master: f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181)
I20260812 06:36:26.131531 30926 consensus_queue.cc:579] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: The tablet replica hosted on peer f3bbc9d57e1d4a90893192ce9d819127 has failed
W20260812 06:36:26.131836 30373 catalog_manager.cc:5632] Tablet 776e94bec0a442d89b8633bf19fce6eb (table test-workload [id=ff357b13bc104912a7a4d0141714e592]) has failed on TS f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): Corruption: Unable to start RaftConsensus: The last op in the WAL with id 0.0 has a term (0) that is greater than the latest recorded term, which is -1
I20260812 06:36:26.132575 30373 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:44567
I20260812 06:36:26.132718 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 30336
W20260812 06:36:26.143612 31286 heartbeater.cc:646] Failed to heartbeat to 127.28.177.190:46113 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.28.177.190:46113 (error 108)
W20260812 06:36:26.144228 31060 heartbeater.cc:646] Failed to heartbeat to 127.28.177.190:46113 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.28.177.190:46113 (error 108)
I20260812 06:36:26.144527 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:46113
--webserver_interface=127.28.177.190
--webserver_port=43979
--builtin_ntp_servers=127.28.177.148:35307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:46113
--master_tombstone_evicted_tablet_replicas=false
--master_tombstone_evicted_tablet_replicas=true with env {}
W20260812 06:36:26.145183 31286 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:36:26.250524 31296 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:26.250715 31296 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:26.250756 31296 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:26.253925 31296 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:26.253997 31296 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:26.254017 31296 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:26.254035 31296 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:26.257761 31296 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:35307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:46113
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:46113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=43979
--never_fsync=true
--heap_profile_path=/tmp/kudu.31296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:26.258744 31296 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:26.259747 31296 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:26.264817 31301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:26.264876 31296 server_base.cc:1061] running on GCE node
W20260812 06:36:26.264815 31304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:26.264812 31302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:26.265527 31296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:26.266284 31296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:26.267434 31296 hybrid_clock.cc:648] HybridClock initialized: now 1786516586267409 us; error 37 us; skew 500 ppm
I20260812 06:36:26.269097 31296 webserver.cc:533] Webserver started at http://127.28.177.190:43979/ using document root <none> and password file <none>
I20260812 06:36:26.269753 31296 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:26.269848 31296 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:26.273033 31296 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.001s
I20260812 06:36:26.274783 31310 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:26.275740 31296 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:26.275871 31296 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "e122662109024e9ba0747332f5791ac8"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-cbbz"
I20260812 06:36:26.276297 31296 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:26.292699 31296 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:26.293331 31296 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:26.293519 31296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:26.301151 31367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:46113 every 8 connection(s)
I20260812 06:36:26.301159 31296 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:46113
I20260812 06:36:26.302239 31296 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:26.306157 31368 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:36:26.307657 31368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Bootstrap starting.
I20260812 06:36:26.310087 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 31296
I20260812 06:36:26.311954 30543 raft_consensus.cc:1217] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260812 06:36:26.319986 30597 heartbeater.cc:646] Failed to heartbeat to 127.28.177.190:46113 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:36:26.320020 31060 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:26.325054 31368 log.cc:826] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:26.332726 31368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=3 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:26.333096 31368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Bootstrap complete.
I20260812 06:36:26.336530 31368 raft_consensus.cc:359] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:26.336894 31368 raft_consensus.cc:740] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e122662109024e9ba0747332f5791ac8, State: Initialized, Role: FOLLOWER
I20260812 06:36:26.337338 31368 consensus_queue.cc:260] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:26.337486 31368 raft_consensus.cc:399] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:26.337564 31368 raft_consensus.cc:493] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:26.337702 31368 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:26.339213 31368 raft_consensus.cc:515] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:26.339545 31368 leader_election.cc:304] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e122662109024e9ba0747332f5791ac8; no voters: 
I20260812 06:36:26.339841 31368 leader_election.cc:290] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 06:36:26.340001 31374 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:26.340291 31374 raft_consensus.cc:697] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [term 2 LEADER]: Becoming Leader. State: Replica: e122662109024e9ba0747332f5791ac8, State: Running, Role: LEADER
I20260812 06:36:26.340576 31374 consensus_queue.cc:237] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } }
I20260812 06:36:26.341068 31368 sys_catalog.cc:565] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:26.341981 31375 sys_catalog.cc:455] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e122662109024e9ba0747332f5791ac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } } }
I20260812 06:36:26.342156 31375 sys_catalog.cc:458] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:26.342010 31376 sys_catalog.cc:455] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e122662109024e9ba0747332f5791ac8. Latest consensus state: current_term: 2 leader_uuid: "e122662109024e9ba0747332f5791ac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e122662109024e9ba0747332f5791ac8" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 46113 } } }
I20260812 06:36:26.342443 31376 sys_catalog.cc:458] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:26.342794 31382 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:26.346369 31382 catalog_manager.cc:679] Loaded metadata for table test-workload [id=ff357b13bc104912a7a4d0141714e592]
I20260812 06:36:26.347648 31382 tablet_loader.cc:96] loaded metadata for tablet 776e94bec0a442d89b8633bf19fce6eb (table test-workload [id=ff357b13bc104912a7a4d0141714e592])
I20260812 06:36:26.347816 31382 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:26.348483 31382 catalog_manager.cc:1295] Loaded cluster ID: e96d45e8ba544baea88b8b4e8ffd546d
I20260812 06:36:26.348541 31382 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:26.350801 31382 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:26.351518 31382 catalog_manager.cc:6103] T 00000000000000000000000000000000 P e122662109024e9ba0747332f5791ac8: Loaded TSK: 0
I20260812 06:36:26.352527 31382 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:26.519157 31327 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" instance_seqno: 1786516580203156) as {username='slave'} at 127.28.177.131:36803; Asking this server to re-register.
I20260812 06:36:26.519686 30900 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:26.519913 30900 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:26.521130 31327 ts_manager.cc:194] Registered new tserver with Master: 80feb1fbc0c14ce7b75b5cba3c3a0baf (127.28.177.131:33435)
I20260812 06:36:26.810869 31111 raft_consensus.cc:1064] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670: attempting to promote NON_VOTER a2bd9243fbf64361bff1e92c11442e48 to VOTER
I20260812 06:36:26.811407 31111 consensus_queue.cc:237] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } }
I20260812 06:36:26.812980 30543 raft_consensus.cc:1275] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 LEARNER]: Refusing update from remote peer fa21491bb53a405da48db4f2ce0cb670: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:36:26.813093 30845 raft_consensus.cc:1275] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Refusing update from remote peer fa21491bb53a405da48db4f2ce0cb670: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:36:26.813346 30926 consensus_queue.cc:579] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: The tablet replica hosted on peer f3bbc9d57e1d4a90893192ce9d819127 has failed
W20260812 06:36:26.813449 30926 consensus_peers.cc:597] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 -> Peer f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): Couldn't send request to peer f3bbc9d57e1d4a90893192ce9d819127. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: Corruption: Unable to start RaftConsensus: The last op in the WAL with id 0.0 has a term (0) that is greater than the latest recorded term, which is -1. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:26.813604 31398 consensus_queue.cc:1048] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:36:26.813773 31397 consensus_queue.cc:1048] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:36:26.814765 31327 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" instance_seqno: 1786516580382644) as {username='slave'} at 127.28.177.132:49157; Asking this server to re-register.
I20260812 06:36:26.815347 31060 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:26.815521 31060 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:26.816473 31327 ts_manager.cc:194] Registered new tserver with Master: fa21491bb53a405da48db4f2ce0cb670 (127.28.177.132:44997)
I20260812 06:36:26.816694 31397 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } } }
I20260812 06:36:26.817281 30543 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } } }
I20260812 06:36:26.819115 31327 catalog_manager.cc:5719] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 reported cstate change: config changed from index 2 to 3, a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa21491bb53a405da48db4f2ce0cb670" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } health_report { overall_health: FAILED_UNRECOVERABLE } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 06:36:26.819329 30845 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "f3bbc9d57e1d4a90893192ce9d819127" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 46181 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } } }
I20260812 06:36:26.823217 31326 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" instance_seqno: 1786516579853134) as {username='slave'} at 127.28.177.129:59765; Asking this server to re-register.
I20260812 06:36:26.823637 30597 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:26.823825 30597 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:26.824693 31325 ts_manager.cc:194] Registered new tserver with Master: a2bd9243fbf64361bff1e92c11442e48 (127.28.177.129:39251)
I20260812 06:36:26.830633 31009 consensus_queue.cc:237] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } }
I20260812 06:36:26.831732 30543 raft_consensus.cc:1275] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 FOLLOWER]: Refusing update from remote peer fa21491bb53a405da48db4f2ce0cb670: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 06:36:26.831868 30845 raft_consensus.cc:1275] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Refusing update from remote peer fa21491bb53a405da48db4f2ce0cb670: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 06:36:26.832159 31111 consensus_queue.cc:1048] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:36:26.832325 31370 consensus_queue.cc:1048] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:36:26.833841 31370 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } } }
I20260812 06:36:26.834295 30845 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P 80feb1fbc0c14ce7b75b5cba3c3a0baf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } } }
I20260812 06:36:26.834636 30543 raft_consensus.cc:2955] T 776e94bec0a442d89b8633bf19fce6eb P a2bd9243fbf64361bff1e92c11442e48 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } } }
I20260812 06:36:26.836071 31312 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet 776e94bec0a442d89b8633bf19fce6eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 06:36:26.836097 31327 catalog_manager.cc:5719] T 776e94bec0a442d89b8633bf19fce6eb P fa21491bb53a405da48db4f2ce0cb670 reported cstate change: config changed from index 3 to 4, VOTER f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130) evicted. New cstate: current_term: 1 leader_uuid: "fa21491bb53a405da48db4f2ce0cb670" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "fa21491bb53a405da48db4f2ce0cb670" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 44997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80feb1fbc0c14ce7b75b5cba3c3a0baf" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 33435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2bd9243fbf64361bff1e92c11442e48" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39251 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260812 06:36:26.838322 31327 catalog_manager.cc:5911] Failed to send DeleteTablet RPC for tablet 776e94bec0a442d89b8633bf19fce6eb on TS f3bbc9d57e1d4a90893192ce9d819127: Not found: failed to reset TS proxy: Could not find TS for UUID f3bbc9d57e1d4a90893192ce9d819127
W20260812 06:36:26.891538 31312 catalog_manager.cc:4832] Async tablet task DeleteTablet RPC for tablet 776e94bec0a442d89b8633bf19fce6eb on TS f3bbc9d57e1d4a90893192ce9d819127 failed: Not found: failed to reset TS proxy: Could not find TS for UUID f3bbc9d57e1d4a90893192ce9d819127
I20260812 06:36:27.149744 31286 heartbeater.cc:344] Connected to a master server at 127.28.177.190:46113
I20260812 06:36:27.149868 31286 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:27.150092 31286 heartbeater.cc:507] Master 127.28.177.190:46113 requested a full tablet report, sending...
I20260812 06:36:27.150898 31326 ts_manager.cc:194] Registered new tserver with Master: f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181)
I20260812 06:36:27.152024 31326 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:50897
I20260812 06:36:27.214190 31208 tablet_service.cc:1558] Processing DeleteTablet for tablet 776e94bec0a442d89b8633bf19fce6eb with delete_type TABLET_DATA_TOMBSTONED (TS f3bbc9d57e1d4a90893192ce9d819127 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47908
I20260812 06:36:27.214861 31410 ts_tablet_manager.cc:1916] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:27.218483 31410 ts_tablet_manager.cc:1929] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260812 06:36:27.218607 31410 log.cc:1199] T 776e94bec0a442d89b8633bf19fce6eb P f3bbc9d57e1d4a90893192ce9d819127: Deleting WAL directory at /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal/wals/776e94bec0a442d89b8633bf19fce6eb
I20260812 06:36:27.219311 31313 catalog_manager.cc:5050] TS f3bbc9d57e1d4a90893192ce9d819127 (127.28.177.130:46181): tablet 776e94bec0a442d89b8633bf19fce6eb (table test-workload [id=ff357b13bc104912a7a4d0141714e592]) successfully deleted
I20260812 06:36:27.223752 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 30440
I20260812 06:36:27.234117 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 31137
I20260812 06:36:27.245898 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 30747
I20260812 06:36:27.254987 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 30903
I20260812 06:36:27.262738 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 31296
2026-08-12T06:36:27Z chronyd exiting
[       OK ] TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport (7831 ms)
[ RUN      ] TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport
2026-08-12T06:36:27Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:27Z Disabled control of system clock
I20260812 06:36:27.295343 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:36247
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:44953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:36247
--master_add_server_when_underreplicated=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:36:27.397970 31414 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:27.398165 31414 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:27.398200 31414 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:27.401456 31414 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:27.401511 31414 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:27.401531 31414 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:27.401548 31414 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:27.405750 31414 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:44953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:36247
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:36247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:27.406818 31414 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:27.407891 31414 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:27.413280 31420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:27.413359 31422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:27.413288 31419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:27.413558 31414 server_base.cc:1061] running on GCE node
I20260812 06:36:27.414057 31414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:27.414885 31414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:27.416076 31414 hybrid_clock.cc:648] HybridClock initialized: now 1786516587416060 us; error 33 us; skew 500 ppm
I20260812 06:36:27.417728 31414 webserver.cc:533] Webserver started at http://127.28.177.190:33635/ using document root <none> and password file <none>
I20260812 06:36:27.418296 31414 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:27.418381 31414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:27.418601 31414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:27.420056 31414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "ed765a7125d846c9a7f76078b895ed5b"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.420603 31414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "ed765a7125d846c9a7f76078b895ed5b"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.423707 31414 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:27.425772 31430 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.426740 31414 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:36:27.426877 31414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "ed765a7125d846c9a7f76078b895ed5b"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.426977 31414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:27.452967 31414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:27.453706 31414 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:27.453912 31414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:27.461509 31414 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:36247
I20260812 06:36:27.461529 31488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:36247 every 8 connection(s)
I20260812 06:36:27.462525 31414 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:27.465459 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:27.470654 31489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b: Bootstrap starting.
I20260812 06:36:27.470906 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 31414
I20260812 06:36:27.471016 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:27.473480 31489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:27.474273 31489 log.cc:826] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:27.475961 31489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b: No bootstrap required, opened a new log
I20260812 06:36:27.478837 31489 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed765a7125d846c9a7f76078b895ed5b" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36247 } }
I20260812 06:36:27.479050 31489 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:27.479146 31489 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed765a7125d846c9a7f76078b895ed5b, State: Initialized, Role: FOLLOWER
I20260812 06:36:27.479636 31489 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed765a7125d846c9a7f76078b895ed5b" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36247 } }
I20260812 06:36:27.479809 31489 raft_consensus.cc:399] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:27.479894 31489 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:27.480055 31489 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:27.480867 31489 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed765a7125d846c9a7f76078b895ed5b" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36247 } }
I20260812 06:36:27.481166 31489 leader_election.cc:304] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed765a7125d846c9a7f76078b895ed5b; no voters: 
I20260812 06:36:27.481410 31489 leader_election.cc:290] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:27.481532 31495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:27.481789 31495 raft_consensus.cc:697] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [term 1 LEADER]: Becoming Leader. State: Replica: ed765a7125d846c9a7f76078b895ed5b, State: Running, Role: LEADER
I20260812 06:36:27.482110 31495 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed765a7125d846c9a7f76078b895ed5b" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36247 } }
I20260812 06:36:27.482649 31489 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:27.483659 31496 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed765a7125d846c9a7f76078b895ed5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed765a7125d846c9a7f76078b895ed5b" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36247 } } }
I20260812 06:36:27.483978 31497 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed765a7125d846c9a7f76078b895ed5b. Latest consensus state: current_term: 1 leader_uuid: "ed765a7125d846c9a7f76078b895ed5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed765a7125d846c9a7f76078b895ed5b" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36247 } } }
I20260812 06:36:27.484254 31497 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:27.484110 31496 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b [sys.catalog]: This master's current role is: LEADER
W20260812 06:36:27.487708 31513 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:27.487774 31513 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:27.487857 31505 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:27.488698 31505 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:27.493378 31505 catalog_manager.cc:1383] Generated new cluster ID: bd4fd6b4fea74d579331bcd522236bfd
I20260812 06:36:27.493443 31505 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:27.505728 31505 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:27.506552 31505 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:27.511045 31505 catalog_manager.cc:6092] T 00000000000000000000000000000000 P ed765a7125d846c9a7f76078b895ed5b: Generated new TSK 0
I20260812 06:36:27.511703 31505 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:27.524482 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36247
--builtin_ntp_servers=127.28.177.148:44953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 06:36:27.644606 31516 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:27.644817 31516 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:27.644838 31516 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:27.644951 31516 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:27.648281 31516 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:27.648413 31516 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:27.652273 31516 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:44953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36247
--never_fsync=true
--heap_profile_path=/tmp/kudu.31516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:27.653327 31516 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:27.654470 31516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:27.660714 31525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:27.660732 31522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:27.661012 31516 server_base.cc:1061] running on GCE node
W20260812 06:36:27.661239 31523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:27.661659 31516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:27.662253 31516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:27.663424 31516 hybrid_clock.cc:648] HybridClock initialized: now 1786516587663405 us; error 36 us; skew 500 ppm
I20260812 06:36:27.665395 31516 webserver.cc:533] Webserver started at http://127.28.177.129:39549/ using document root <none> and password file <none>
I20260812 06:36:27.666026 31516 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:27.666097 31516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:27.666288 31516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:27.668196 31516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "b45eccb01ab64b7595c6001e56a0084c"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.668768 31516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "b45eccb01ab64b7595c6001e56a0084c"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.671952 31516 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:36:27.674029 31532 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.675009 31516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:27.675132 31516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "b45eccb01ab64b7595c6001e56a0084c"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.675235 31516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:27.696578 31516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:27.697269 31516 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:27.697466 31516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:27.698063 31516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:27.699087 31516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:27.699136 31516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.699210 31516 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:27.699247 31516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.708774 31516 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:37733
I20260812 06:36:27.708842 31662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:37733 every 8 connection(s)
I20260812 06:36:27.709758 31516 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:27.711784 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 31516
I20260812 06:36:27.711874 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:27.714267 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36247
--builtin_ntp_servers=127.28.177.148:44953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:27.719532 31663 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36247
I20260812 06:36:27.719784 31663 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:27.720369 31663 heartbeater.cc:507] Master 127.28.177.190:36247 requested a full tablet report, sending...
I20260812 06:36:27.722100 31448 ts_manager.cc:194] Registered new tserver with Master: b45eccb01ab64b7595c6001e56a0084c (127.28.177.129:37733)
I20260812 06:36:27.723865 31448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:38191
W20260812 06:36:27.819007 31669 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:27.819202 31669 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:27.819223 31669 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:27.819262 31669 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:27.822511 31669 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:27.822606 31669 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:27.826192 31669 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:44953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36247
--never_fsync=true
--heap_profile_path=/tmp/kudu.31669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:27.827121 31669 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:27.828162 31669 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:27.834362 31678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:27.834362 31676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:27.834474 31675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:27.834740 31669 server_base.cc:1061] running on GCE node
I20260812 06:36:27.835110 31669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:27.835671 31669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:27.836850 31669 hybrid_clock.cc:648] HybridClock initialized: now 1786516587836833 us; error 32 us; skew 500 ppm
I20260812 06:36:27.838423 31669 webserver.cc:533] Webserver started at http://127.28.177.130:36751/ using document root <none> and password file <none>
I20260812 06:36:27.838969 31669 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:27.839054 31669 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:27.839274 31669 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:27.840865 31669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "68d9fc24d1f543bb82a9a0a1397ab70f"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.841338 31669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "68d9fc24d1f543bb82a9a0a1397ab70f"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.844532 31669 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:27.846676 31684 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.847649 31669 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:27.847795 31669 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "68d9fc24d1f543bb82a9a0a1397ab70f"
format_stamp: "Formatted at 2026-08-12 06:36:27 on dist-test-slave-cbbz"
I20260812 06:36:27.847903 31669 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:27.858706 31669 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:27.859256 31669 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:27.859439 31669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:27.859954 31669 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:27.860935 31669 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:27.861008 31669 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.861074 31669 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:27.861132 31669 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:27.870045 31669 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:45933
I20260812 06:36:27.870126 31809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:45933 every 8 connection(s)
I20260812 06:36:27.870942 31669 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:27.879542 31810 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36247
I20260812 06:36:27.879806 31810 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:27.880383 31810 heartbeater.cc:507] Master 127.28.177.190:36247 requested a full tablet report, sending...
I20260812 06:36:27.880681 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 31669
I20260812 06:36:27.880807 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:27.881603 31448 ts_manager.cc:194] Registered new tserver with Master: 68d9fc24d1f543bb82a9a0a1397ab70f (127.28.177.130:45933)
I20260812 06:36:27.882378 31448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:44567
I20260812 06:36:27.883528 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36247
--builtin_ntp_servers=127.28.177.148:44953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 06:36:27.987022 31813 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:27.987221 31813 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:27.987242 31813 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:27.987280 31813 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:27.990526 31813 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:27.990630 31813 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:27.994264 31813 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:44953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36247
--never_fsync=true
--heap_profile_path=/tmp/kudu.31813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:27.995121 31813 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:27.996065 31813 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:28.002485 31822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:28.002497 31819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:28.002784 31820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:28.002781 31813 server_base.cc:1061] running on GCE node
I20260812 06:36:28.003254 31813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:28.004001 31813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:28.005156 31813 hybrid_clock.cc:648] HybridClock initialized: now 1786516588005132 us; error 37 us; skew 500 ppm
I20260812 06:36:28.007401 31813 webserver.cc:533] Webserver started at http://127.28.177.131:34921/ using document root <none> and password file <none>
I20260812 06:36:28.008174 31813 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:28.008256 31813 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:28.008503 31813 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:28.010834 31813 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "3cdf2adbe0c34d5bbc94561ec2db8436"
format_stamp: "Formatted at 2026-08-12 06:36:28 on dist-test-slave-cbbz"
I20260812 06:36:28.011471 31813 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "3cdf2adbe0c34d5bbc94561ec2db8436"
format_stamp: "Formatted at 2026-08-12 06:36:28 on dist-test-slave-cbbz"
I20260812 06:36:28.016705 31813 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:28.019551 31828 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:28.020857 31813 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:28.020973 31813 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "3cdf2adbe0c34d5bbc94561ec2db8436"
format_stamp: "Formatted at 2026-08-12 06:36:28 on dist-test-slave-cbbz"
I20260812 06:36:28.021081 31813 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:28.043884 31813 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:28.044627 31813 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:28.044827 31813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:28.045445 31813 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:28.046396 31813 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:28.046443 31813 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:28.046505 31813 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:28.046542 31813 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:28.056167 31813 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:39999
I20260812 06:36:28.056205 31955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:39999 every 8 connection(s)
I20260812 06:36:28.057108 31813 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:28.060210 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 31813
I20260812 06:36:28.060294 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:28.066352 31956 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36247
I20260812 06:36:28.066624 31956 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:28.067109 31956 heartbeater.cc:507] Master 127.28.177.190:36247 requested a full tablet report, sending...
I20260812 06:36:28.068112 31448 ts_manager.cc:194] Registered new tserver with Master: 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131:39999)
I20260812 06:36:28.068720 31448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:33283
I20260812 06:36:28.074123 29382 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:28.090857 31448 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55370:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:28.091954 31448 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:28.108449 31589 tablet_service.cc:1511] Processing CreateTablet for tablet 390b0da0ee2a41b5bb09364835ace5a8 (DEFAULT_TABLE table=test-workload [id=9d06ff29bc374880b7095d4ded249d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:28.108518 31736 tablet_service.cc:1511] Processing CreateTablet for tablet 390b0da0ee2a41b5bb09364835ace5a8 (DEFAULT_TABLE table=test-workload [id=9d06ff29bc374880b7095d4ded249d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:28.109386 31589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390b0da0ee2a41b5bb09364835ace5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:28.109473 31736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390b0da0ee2a41b5bb09364835ace5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:28.109198 31881 tablet_service.cc:1511] Processing CreateTablet for tablet 390b0da0ee2a41b5bb09364835ace5a8 (DEFAULT_TABLE table=test-workload [id=9d06ff29bc374880b7095d4ded249d68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:28.110014 31881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390b0da0ee2a41b5bb09364835ace5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:28.114887 31981 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: Bootstrap starting.
I20260812 06:36:28.115383 31983 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Bootstrap starting.
I20260812 06:36:28.115581 31984 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: Bootstrap starting.
I20260812 06:36:28.117291 31981 tablet_bootstrap.cc:654] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:28.117654 31984 tablet_bootstrap.cc:654] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:28.117654 31983 tablet_bootstrap.cc:654] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:28.118057 31981 log.cc:826] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:28.118448 31984 log.cc:826] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:28.118448 31983 log.cc:826] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:28.119699 31981 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: No bootstrap required, opened a new log
I20260812 06:36:28.119897 31984 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: No bootstrap required, opened a new log
I20260812 06:36:28.119891 31981 ts_tablet_manager.cc:1403] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20260812 06:36:28.120042 31983 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: No bootstrap required, opened a new log
I20260812 06:36:28.120110 31984 ts_tablet_manager.cc:1403] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:28.120244 31983 ts_tablet_manager.cc:1403] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:28.122629 31984 raft_consensus.cc:359] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.122786 31984 raft_consensus.cc:740] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68d9fc24d1f543bb82a9a0a1397ab70f, State: Initialized, Role: FOLLOWER
I20260812 06:36:28.123006 31984 consensus_queue.cc:260] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.123011 31983 raft_consensus.cc:359] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.123008 31981 raft_consensus.cc:359] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.123194 31981 raft_consensus.cc:740] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45eccb01ab64b7595c6001e56a0084c, State: Initialized, Role: FOLLOWER
I20260812 06:36:28.123194 31983 raft_consensus.cc:740] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cdf2adbe0c34d5bbc94561ec2db8436, State: Initialized, Role: FOLLOWER
I20260812 06:36:28.123477 31983 consensus_queue.cc:260] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.123477 31981 consensus_queue.cc:260] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.123564 31810 heartbeater.cc:499] Master 127.28.177.190:36247 was elected leader, sending a full tablet report...
I20260812 06:36:28.123790 31984 ts_tablet_manager.cc:1434] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:36:28.124279 31981 ts_tablet_manager.cc:1434] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.001s
I20260812 06:36:28.124279 31983 ts_tablet_manager.cc:1434] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:28.124411 31956 heartbeater.cc:499] Master 127.28.177.190:36247 was elected leader, sending a full tablet report...
I20260812 06:36:28.124593 31663 heartbeater.cc:499] Master 127.28.177.190:36247 was elected leader, sending a full tablet report...
W20260812 06:36:28.124564 31811 tablet.cc:2406] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:28.145746 31610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390b0da0ee2a41b5bb09364835ace5a8"
dest_uuid: "b45eccb01ab64b7595c6001e56a0084c"
 from {username='slave'} at 127.0.0.1:60266
I20260812 06:36:28.145951 31610 raft_consensus.cc:493] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:28.146085 31610 raft_consensus.cc:3060] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:28.147014 31610 raft_consensus.cc:515] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.148017 31610 leader_election.cc:290] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [CANDIDATE]: Term 1 election: Requested vote from peers 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131:39999), 68d9fc24d1f543bb82a9a0a1397ab70f (127.28.177.130:45933)
I20260812 06:36:28.151227 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:36:28.152413 31904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b0da0ee2a41b5bb09364835ace5a8" candidate_uuid: "b45eccb01ab64b7595c6001e56a0084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436"
I20260812 06:36:28.152546 31758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b0da0ee2a41b5bb09364835ace5a8" candidate_uuid: "b45eccb01ab64b7595c6001e56a0084c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f"
I20260812 06:36:28.152607 31904 raft_consensus.cc:3060] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:28.152762 31758 raft_consensus.cc:3060] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:28.153620 31904 raft_consensus.cc:2468] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45eccb01ab64b7595c6001e56a0084c in term 1.
I20260812 06:36:28.153762 31758 raft_consensus.cc:2468] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45eccb01ab64b7595c6001e56a0084c in term 1.
I20260812 06:36:28.154094 31536 leader_election.cc:304] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cdf2adbe0c34d5bbc94561ec2db8436, b45eccb01ab64b7595c6001e56a0084c; no voters: 
I20260812 06:36:28.154354 31992 raft_consensus.cc:2804] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:28.154570 31992 raft_consensus.cc:697] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 1 LEADER]: Becoming Leader. State: Replica: b45eccb01ab64b7595c6001e56a0084c, State: Running, Role: LEADER
I20260812 06:36:28.154906 31992 consensus_queue.cc:237] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.158210 31447 catalog_manager.cc:5719] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c reported cstate change: term changed from 0 to 1, leader changed from <none> to b45eccb01ab64b7595c6001e56a0084c (127.28.177.129). New cstate: current_term: 1 leader_uuid: "b45eccb01ab64b7595c6001e56a0084c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:28.210906 31667 tablet.cc:2406] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:28.254465 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
W20260812 06:36:28.308082 31957 tablet.cc:2406] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:28.457379 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
I20260812 06:36:28.573076 31992 consensus_queue.cc:1048] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:28.578855 31999 consensus_queue.cc:1048] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:28.761293 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 31813
I20260812 06:36:28.773140 31610 consensus_queue.cc:237] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.774545 31758 raft_consensus.cc:1275] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [term 1 FOLLOWER]: Refusing update from remote peer b45eccb01ab64b7595c6001e56a0084c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:28.775002 31999 consensus_queue.cc:1048] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [LEADER]: Connected to new peer: Peer: permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:36:28.776891 31992 raft_consensus.cc:2955] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } } }
I20260812 06:36:28.777426 31758 raft_consensus.cc:2955] T 390b0da0ee2a41b5bb09364835ace5a8 P 68d9fc24d1f543bb82a9a0a1397ab70f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } } }
I20260812 06:36:28.779711 31445 catalog_manager.cc:5719] T 390b0da0ee2a41b5bb09364835ace5a8 P b45eccb01ab64b7595c6001e56a0084c reported cstate change: config changed from index -1 to 2, VOTER 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131) evicted. New cstate: current_term: 1 leader_uuid: "b45eccb01ab64b7595c6001e56a0084c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:28.783324 31432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.131:39999: connect: Connection refused (error 111)
W20260812 06:36:28.784405 31432 catalog_manager.cc:4777] TS 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131:39999): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 390b0da0ee2a41b5bb09364835ace5a8: Network error: Client connection negotiation failed: client connection to 127.28.177.131:39999: connect: Connection refused (error 111)
I20260812 06:36:28.791865 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 31516
I20260812 06:36:28.806645 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 31669
I20260812 06:36:28.815408 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:39999
--local_ip_for_outbound_sockets=127.28.177.131
--tserver_master_addrs=127.28.177.190:36247
--webserver_port=34921
--webserver_interface=127.28.177.131
--builtin_ntp_servers=127.28.177.148:44953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 06:36:28.916935 32009 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:28.917147 32009 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:28.917171 32009 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:28.917212 32009 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:28.920405 32009 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:28.920500 32009 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:28.924103 32009 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:44953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:39999
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=34921
--tserver_master_addrs=127.28.177.190:36247
--never_fsync=true
--heap_profile_path=/tmp/kudu.32009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:28.925099 32009 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:28.926172 32009 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:28.932616 32014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:28.932644 32015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:28.932634 32017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:28.932946 32009 server_base.cc:1061] running on GCE node
I20260812 06:36:28.933346 32009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:28.933915 32009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:28.935109 32009 hybrid_clock.cc:648] HybridClock initialized: now 1786516588935092 us; error 36 us; skew 500 ppm
I20260812 06:36:28.936908 32009 webserver.cc:533] Webserver started at http://127.28.177.131:34921/ using document root <none> and password file <none>
I20260812 06:36:28.937511 32009 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:28.937623 32009 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:28.941057 32009 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:28.943176 32023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:28.944176 32009 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:28.944322 32009 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "3cdf2adbe0c34d5bbc94561ec2db8436"
format_stamp: "Formatted at 2026-08-12 06:36:28 on dist-test-slave-cbbz"
I20260812 06:36:28.944728 32009 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:28.960925 32009 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:28.961644 32009 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:28.961871 32009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:28.962473 32009 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:28.963755 32031 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:36:28.967341 32009 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:36:28.967445 32009 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:36:28.967525 32009 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:36:28.969080 32009 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:36:28.969151 32009 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:28.969477 32031 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Bootstrap starting.
I20260812 06:36:28.981053 32009 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:39999
I20260812 06:36:28.981158 32145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:39999 every 8 connection(s)
I20260812 06:36:28.982131 32009 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:28.985841 32031 log.cc:826] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:28.988175 32031 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:28.988612 32031 tablet_bootstrap.cc:492] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Bootstrap complete.
I20260812 06:36:28.989859 32031 ts_tablet_manager.cc:1403] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260812 06:36:28.990761 32146 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36247
I20260812 06:36:28.991012 32146 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:28.991040 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 32009
I20260812 06:36:28.991516 32146 heartbeater.cc:507] Master 127.28.177.190:36247 requested a full tablet report, sending...
I20260812 06:36:28.992997 32031 raft_consensus.cc:359] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.993396 31444 ts_manager.cc:194] Re-registered known tserver with Master: 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131:39999)
I20260812 06:36:28.993394 32031 raft_consensus.cc:740] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cdf2adbe0c34d5bbc94561ec2db8436, State: Initialized, Role: FOLLOWER
I20260812 06:36:28.993755 32031 consensus_queue.cc:260] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cdf2adbe0c34d5bbc94561ec2db8436" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 39999 } } peers { permanent_uuid: "68d9fc24d1f543bb82a9a0a1397ab70f" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45933 } } peers { permanent_uuid: "b45eccb01ab64b7595c6001e56a0084c" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 37733 } }
I20260812 06:36:28.994499 31444 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:36967
I20260812 06:36:28.994700 32031 ts_tablet_manager.cc:1434] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 06:36:28.996097 32146 heartbeater.cc:499] Master 127.28.177.190:36247 was elected leader, sending a full tablet report...
I20260812 06:36:29.156597 32075 tablet_service.cc:1558] Processing DeleteTablet for tablet 390b0da0ee2a41b5bb09364835ace5a8 with delete_type TABLET_DATA_TOMBSTONED (TS 3cdf2adbe0c34d5bbc94561ec2db8436 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:35926
I20260812 06:36:29.157405 32155 tablet_replica.cc:333] stopping tablet replica
I20260812 06:36:29.157676 32155 raft_consensus.cc:2243] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:29.157953 32155 raft_consensus.cc:2272] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:29.158949 32155 ts_tablet_manager.cc:1916] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:29.161955 32155 ts_tablet_manager.cc:1929] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 06:36:29.162031 32155 log.cc:1199] T 390b0da0ee2a41b5bb09364835ace5a8 P 3cdf2adbe0c34d5bbc94561ec2db8436: Deleting WAL directory at /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786516569449997-29382-0/minicluster-data/ts-2/wal/wals/390b0da0ee2a41b5bb09364835ace5a8
I20260812 06:36:29.162878 31432 catalog_manager.cc:5050] TS 3cdf2adbe0c34d5bbc94561ec2db8436 (127.28.177.131:39999): tablet 390b0da0ee2a41b5bb09364835ace5a8 (table test-workload [id=9d06ff29bc374880b7095d4ded249d68]) successfully deleted
I20260812 06:36:29.164259 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 32009
I20260812 06:36:29.174315 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 31414
2026-08-12T06:36:29Z chronyd exiting
[       OK ] TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport (1911 ms)
[ RUN      ] TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits
2026-08-12T06:36:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:29Z Disabled control of system clock
I20260812 06:36:29.206456 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:37679
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:37679
--master_add_server_when_underreplicated=false
--master_tombstone_evicted_tablet_replicas=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:36:29.309676 32159 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:29.309877 32159 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:29.309917 32159 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:29.313277 32159 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:29.313330 32159 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:29.313350 32159 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:29.313367 32159 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:29.317099 32159 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:37679
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:37679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.32159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:29.318171 32159 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:29.319283 32159 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:29.325012 32165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.324999 32167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.325129 32159 server_base.cc:1061] running on GCE node
W20260812 06:36:29.325001 32164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.325817 32159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:29.326609 32159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:29.327814 32159 hybrid_clock.cc:648] HybridClock initialized: now 1786516589327804 us; error 28 us; skew 500 ppm
I20260812 06:36:29.329548 32159 webserver.cc:533] Webserver started at http://127.28.177.190:44419/ using document root <none> and password file <none>
I20260812 06:36:29.330153 32159 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:29.330240 32159 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:29.330461 32159 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:29.331970 32159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "29ad13e57b6244a7b28131f2dade8b58"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.332504 32159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "29ad13e57b6244a7b28131f2dade8b58"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.335752 32159 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:29.337872 32173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.338829 32159 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:36:29.338974 32159 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "29ad13e57b6244a7b28131f2dade8b58"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.339074 32159 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:29.347848 32159 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:29.348511 32159 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:29.348704 32159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:29.355624 32226 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:37679 every 8 connection(s)
I20260812 06:36:29.355633 32159 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:37679
I20260812 06:36:29.356638 32159 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:29.359364 32227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:29.361407 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 32159
I20260812 06:36:29.361500 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:29.364316 32227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58: Bootstrap starting.
I20260812 06:36:29.366788 32227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:29.367578 32227 log.cc:826] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:29.369467 32227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58: No bootstrap required, opened a new log
I20260812 06:36:29.372006 32227 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ad13e57b6244a7b28131f2dade8b58" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 37679 } }
I20260812 06:36:29.372237 32227 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:29.372282 32227 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ad13e57b6244a7b28131f2dade8b58, State: Initialized, Role: FOLLOWER
I20260812 06:36:29.372604 32227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ad13e57b6244a7b28131f2dade8b58" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 37679 } }
I20260812 06:36:29.372712 32227 raft_consensus.cc:399] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:29.372747 32227 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:29.372822 32227 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:29.373504 32227 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ad13e57b6244a7b28131f2dade8b58" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 37679 } }
I20260812 06:36:29.373780 32227 leader_election.cc:304] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29ad13e57b6244a7b28131f2dade8b58; no voters: 
I20260812 06:36:29.373991 32227 leader_election.cc:290] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:29.374107 32232 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:29.374325 32232 raft_consensus.cc:697] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [term 1 LEADER]: Becoming Leader. State: Replica: 29ad13e57b6244a7b28131f2dade8b58, State: Running, Role: LEADER
I20260812 06:36:29.374655 32232 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ad13e57b6244a7b28131f2dade8b58" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 37679 } }
I20260812 06:36:29.375082 32227 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:29.376470 32233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29ad13e57b6244a7b28131f2dade8b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ad13e57b6244a7b28131f2dade8b58" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 37679 } } }
I20260812 06:36:29.376619 32233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:29.376892 32235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29ad13e57b6244a7b28131f2dade8b58. Latest consensus state: current_term: 1 leader_uuid: "29ad13e57b6244a7b28131f2dade8b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29ad13e57b6244a7b28131f2dade8b58" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 37679 } } }
I20260812 06:36:29.376991 32235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:29.377239 32245 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:29.379912 32245 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:29.385630 32245 catalog_manager.cc:1383] Generated new cluster ID: 42507ea9aefb4876b587103b373ccad8
I20260812 06:36:29.385716 32245 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:29.416383 32245 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:29.417294 32245 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:29.423972 32245 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 29ad13e57b6244a7b28131f2dade8b58: Generated new TSK 0
I20260812 06:36:29.424598 32245 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:29.433320 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:37679
--builtin_ntp_servers=127.28.177.148:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 06:36:29.537730 32255 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:29.537971 32255 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:29.538039 32255 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:29.538131 32255 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:29.541497 32255 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:29.541651 32255 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:29.545686 32255 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:37679
--never_fsync=true
--heap_profile_path=/tmp/kudu.32255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:29.546762 32255 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:29.547920 32255 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:29.554291 32260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.554311 32263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.554291 32261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.554565 32255 server_base.cc:1061] running on GCE node
I20260812 06:36:29.554924 32255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:29.555397 32255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:29.556545 32255 hybrid_clock.cc:648] HybridClock initialized: now 1786516589556529 us; error 30 us; skew 500 ppm
I20260812 06:36:29.558192 32255 webserver.cc:533] Webserver started at http://127.28.177.129:36243/ using document root <none> and password file <none>
I20260812 06:36:29.558792 32255 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:29.558851 32255 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:29.559079 32255 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:29.560633 32255 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "cff35d921307473a859ffb6330338533"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.561088 32255 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "cff35d921307473a859ffb6330338533"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.564205 32255 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:36:29.566181 32269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.567096 32255 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:29.567242 32255 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "cff35d921307473a859ffb6330338533"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.567337 32255 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:29.589896 32255 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:29.590592 32255 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:29.590798 32255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:29.591368 32255 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:29.592399 32255 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:29.592469 32255 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.592537 32255 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:29.592577 32255 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.602104 32255 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:40101
I20260812 06:36:29.602128 32393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:40101 every 8 connection(s)
I20260812 06:36:29.603088 32255 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:29.609720 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 32255
I20260812 06:36:29.609851 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:29.612448 32394 heartbeater.cc:344] Connected to a master server at 127.28.177.190:37679
I20260812 06:36:29.612445 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:37679
--builtin_ntp_servers=127.28.177.148:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:29.612720 32394 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:29.613371 32394 heartbeater.cc:507] Master 127.28.177.190:37679 requested a full tablet report, sending...
I20260812 06:36:29.614846 32190 ts_manager.cc:194] Registered new tserver with Master: cff35d921307473a859ffb6330338533 (127.28.177.129:40101)
I20260812 06:36:29.616055 32190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:33233
W20260812 06:36:29.720983 32397 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:29.721210 32397 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:29.721233 32397 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:29.721359 32397 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:29.724758 32397 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:29.724902 32397 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:29.728760 32397 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:37679
--never_fsync=true
--heap_profile_path=/tmp/kudu.32397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:29.729846 32397 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:29.731029 32397 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:29.737519 32402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.737524 32403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.737530 32405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.737636 32397 server_base.cc:1061] running on GCE node
I20260812 06:36:29.738164 32397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:29.738631 32397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:29.739785 32397 hybrid_clock.cc:648] HybridClock initialized: now 1786516589739764 us; error 32 us; skew 500 ppm
I20260812 06:36:29.741485 32397 webserver.cc:533] Webserver started at http://127.28.177.130:41881/ using document root <none> and password file <none>
I20260812 06:36:29.742046 32397 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:29.742102 32397 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:29.742340 32397 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:29.743947 32397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.744444 32397 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.747537 32397 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:29.749657 32411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.750597 32397 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:29.750733 32397 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.750829 32397 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:29.765355 32397 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:29.766032 32397 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:29.766225 32397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:29.766767 32397 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:29.767750 32397 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:29.767819 32397 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.767889 32397 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:29.767939 32397 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.777305 32397 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:34537
I20260812 06:36:29.777381 32533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:34537 every 8 connection(s)
I20260812 06:36:29.778323 32397 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:29.778944 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 32397
I20260812 06:36:29.779058 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:29.781512 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:37679
--builtin_ntp_servers=127.28.177.148:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:29.787420 32534 heartbeater.cc:344] Connected to a master server at 127.28.177.190:37679
I20260812 06:36:29.787690 32534 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:29.788290 32534 heartbeater.cc:507] Master 127.28.177.190:37679 requested a full tablet report, sending...
I20260812 06:36:29.789429 32190 ts_manager.cc:194] Registered new tserver with Master: 2cd027ad3e9d4ca0b2f1eb7fde882fe7 (127.28.177.130:34537)
I20260812 06:36:29.790262 32190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:53955
W20260812 06:36:29.887224 32539 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:29.887432 32539 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:29.887454 32539 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:29.887491 32539 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:29.890739 32539 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:29.890838 32539 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:29.894528 32539 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:37679
--never_fsync=true
--heap_profile_path=/tmp/kudu.32539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:29.895498 32539 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:29.896656 32539 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:29.902913 32545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.902904 32548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.902969 32546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.903142 32539 server_base.cc:1061] running on GCE node
I20260812 06:36:29.903580 32539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:29.904088 32539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:29.905278 32539 hybrid_clock.cc:648] HybridClock initialized: now 1786516589905254 us; error 35 us; skew 500 ppm
I20260812 06:36:29.906936 32539 webserver.cc:533] Webserver started at http://127.28.177.131:34823/ using document root <none> and password file <none>
I20260812 06:36:29.907490 32539 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:29.907547 32539 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:29.907773 32539 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:29.909299 32539 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "84d660d9d4aa489b8ece72d1bdd440fc"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.909771 32539 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "84d660d9d4aa489b8ece72d1bdd440fc"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.912976 32539 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:29.915020 32554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.915942 32539 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:29.916074 32539 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "84d660d9d4aa489b8ece72d1bdd440fc"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-cbbz"
I20260812 06:36:29.916193 32539 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:29.971038 32539 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:29.971817 32539 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:29.972025 32539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:29.972656 32539 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:29.973697 32539 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:29.973778 32539 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.973862 32539 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:29.973914 32539 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.983160 32539 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:35861
I20260812 06:36:29.983196 32680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:35861 every 8 connection(s)
I20260812 06:36:29.984110 32539 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:29.988461 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 32539
I20260812 06:36:29.988555 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:29.993042 32681 heartbeater.cc:344] Connected to a master server at 127.28.177.190:37679
I20260812 06:36:29.993273 32681 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:29.993773 32681 heartbeater.cc:507] Master 127.28.177.190:37679 requested a full tablet report, sending...
I20260812 06:36:29.994750 32190 ts_manager.cc:194] Registered new tserver with Master: 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131:35861)
I20260812 06:36:29.995299 32190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:37845
I20260812 06:36:30.002513 29382 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:30.019011 32190 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48786:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:30.020242 32190 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:30.036477 32321 tablet_service.cc:1511] Processing CreateTablet for tablet 362acbebb1754578806ecc0b478eabc6 (DEFAULT_TABLE table=test-workload [id=1a40602fe52945b8be900298065345a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:30.036477 32606 tablet_service.cc:1511] Processing CreateTablet for tablet 362acbebb1754578806ecc0b478eabc6 (DEFAULT_TABLE table=test-workload [id=1a40602fe52945b8be900298065345a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:30.036477 32465 tablet_service.cc:1511] Processing CreateTablet for tablet 362acbebb1754578806ecc0b478eabc6 (DEFAULT_TABLE table=test-workload [id=1a40602fe52945b8be900298065345a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:30.037385 32321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362acbebb1754578806ecc0b478eabc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.037396 32465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362acbebb1754578806ecc0b478eabc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.037396 32606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362acbebb1754578806ecc0b478eabc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.042301 32706 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Bootstrap starting.
I20260812 06:36:30.043392 32707 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Bootstrap starting.
I20260812 06:36:30.043836 32708 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: Bootstrap starting.
I20260812 06:36:30.045275 32706 tablet_bootstrap.cc:654] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.045471 32707 tablet_bootstrap.cc:654] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.045897 32708 tablet_bootstrap.cc:654] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.046181 32706 log.cc:826] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.046200 32707 log.cc:826] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.046666 32708 log.cc:826] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.047840 32706 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: No bootstrap required, opened a new log
I20260812 06:36:30.048053 32706 ts_tablet_manager.cc:1403] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:30.048357 32708 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: No bootstrap required, opened a new log
I20260812 06:36:30.048357 32707 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: No bootstrap required, opened a new log
I20260812 06:36:30.048545 32708 ts_tablet_manager.cc:1403] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.001s
I20260812 06:36:30.048545 32707 ts_tablet_manager.cc:1403] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:30.050850 32706 raft_consensus.cc:359] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.051059 32706 raft_consensus.cc:740] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff35d921307473a859ffb6330338533, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.051379 32706 consensus_queue.cc:260] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.051504 32708 raft_consensus.cc:359] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.051502 32707 raft_consensus.cc:359] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.051719 32707 raft_consensus.cc:740] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d660d9d4aa489b8ece72d1bdd440fc, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.051780 32708 raft_consensus.cc:740] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cd027ad3e9d4ca0b2f1eb7fde882fe7, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.052034 32394 heartbeater.cc:499] Master 127.28.177.190:37679 was elected leader, sending a full tablet report...
I20260812 06:36:30.052070 32707 consensus_queue.cc:260] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.052080 32708 consensus_queue.cc:260] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.052302 32706 ts_tablet_manager.cc:1434] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:30.052944 32707 ts_tablet_manager.cc:1434] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:30.052944 32708 ts_tablet_manager.cc:1434] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260812 06:36:30.053295 32534 heartbeater.cc:499] Master 127.28.177.190:37679 was elected leader, sending a full tablet report...
I20260812 06:36:30.053544 32681 heartbeater.cc:499] Master 127.28.177.190:37679 was elected leader, sending a full tablet report...
I20260812 06:36:30.075529 32346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "362acbebb1754578806ecc0b478eabc6"
dest_uuid: "cff35d921307473a859ffb6330338533"
 from {username='slave'} at 127.0.0.1:50920
I20260812 06:36:30.075774 32346 raft_consensus.cc:493] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:30.075912 32346 raft_consensus.cc:3060] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:30.076972 32346 raft_consensus.cc:515] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.078042 32346 leader_election.cc:290] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [CANDIDATE]: Term 1 election: Requested vote from peers 2cd027ad3e9d4ca0b2f1eb7fde882fe7 (127.28.177.130:34537), 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131:35861)
I20260812 06:36:30.082046 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:36:30.082753 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362acbebb1754578806ecc0b478eabc6" candidate_uuid: "cff35d921307473a859ffb6330338533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7"
I20260812 06:36:30.082757 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362acbebb1754578806ecc0b478eabc6" candidate_uuid: "cff35d921307473a859ffb6330338533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "84d660d9d4aa489b8ece72d1bdd440fc"
I20260812 06:36:30.082968 32488 raft_consensus.cc:3060] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:30.082980 32630 raft_consensus.cc:3060] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:30.083936 32488 raft_consensus.cc:2468] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff35d921307473a859ffb6330338533 in term 1.
I20260812 06:36:30.083953 32630 raft_consensus.cc:2468] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff35d921307473a859ffb6330338533 in term 1.
I20260812 06:36:30.084384 32273 leader_election.cc:304] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cd027ad3e9d4ca0b2f1eb7fde882fe7, cff35d921307473a859ffb6330338533; no voters: 
I20260812 06:36:30.084662 32712 raft_consensus.cc:2804] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:30.084918 32712 raft_consensus.cc:697] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 1 LEADER]: Becoming Leader. State: Replica: cff35d921307473a859ffb6330338533, State: Running, Role: LEADER
I20260812 06:36:30.085237 32712 consensus_queue.cc:237] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.088596 32188 catalog_manager.cc:5719] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 reported cstate change: term changed from 0 to 1, leader changed from <none> to cff35d921307473a859ffb6330338533 (127.28.177.129). New cstate: current_term: 1 leader_uuid: "cff35d921307473a859ffb6330338533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:30.104317 32395 tablet.cc:2406] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:30.185026 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
W20260812 06:36:30.235126 32682 tablet.cc:2406] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:30.279507 32536 tablet.cc:2406] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:30.388013 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
I20260812 06:36:30.623243 32721 consensus_queue.cc:1048] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:30.629221 32726 consensus_queue.cc:1048] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:30.703109 32388 generic_service.cc:175] {username='slave'} at 127.0.0.1:50920 changed flags via RPC: tablet_inject_latency_on_apply_write_op_ms from '0' to '5000'
I20260812 06:36:30.706353 29382 cluster_itest_util.cc:258] Not converged past 3 yet: 1.2 1.2 1.3
I20260812 06:36:30.810436 32346 consensus_queue.cc:237] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } }
I20260812 06:36:30.811805 32488 raft_consensus.cc:1275] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 1 FOLLOWER]: Refusing update from remote peer cff35d921307473a859ffb6330338533: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 06:36:30.812304 32726 consensus_queue.cc:1048] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:36:30.814045 32724 raft_consensus.cc:2955] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }
I20260812 06:36:30.814581 32488 raft_consensus.cc:2955] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }
I20260812 06:36:30.816701 32606 tablet_service.cc:1558] Processing DeleteTablet for tablet 362acbebb1754578806ecc0b478eabc6 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:35110
I20260812 06:36:30.817231 32736 tablet_replica.cc:333] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: stopping tablet replica
I20260812 06:36:30.817533 32736 raft_consensus.cc:2243] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:30.817557 32187 catalog_manager.cc:5719] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 reported cstate change: config changed from index -1 to 4, VOTER 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131) evicted. New cstate: current_term: 1 leader_uuid: "cff35d921307473a859ffb6330338533" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } health_report { overall_health: HEALTHY } } }
I20260812 06:36:30.817814 32736 raft_consensus.cc:2272] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:30.819288 32736 ts_tablet_manager.cc:1916] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:30.821980 32736 ts_tablet_manager.cc:1929] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 06:36:30.822062 32736 log.cc:1199] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Deleting WAL directory at /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/wal/wals/362acbebb1754578806ecc0b478eabc6
I20260812 06:36:30.823537 32346 consensus_queue.cc:237] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } }
I20260812 06:36:30.824810 32488 raft_consensus.cc:1275] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 1 FOLLOWER]: Refusing update from remote peer cff35d921307473a859ffb6330338533: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260812 06:36:30.825207 32271 consensus_peers.cc:597] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 -> Peer 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131:35861): Couldn't send request to peer 84d660d9d4aa489b8ece72d1bdd440fc. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:30.825234 32724 consensus_queue.cc:1048] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 06:36:30.826738 32726 raft_consensus.cc:2955] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } } }
I20260812 06:36:30.827219 32488 raft_consensus.cc:2955] T 362acbebb1754578806ecc0b478eabc6 P 2cd027ad3e9d4ca0b2f1eb7fde882fe7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } } }
I20260812 06:36:30.829226 32188 catalog_manager.cc:5719] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533 reported cstate change: config changed from index 4 to 5, VOTER 84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131) added. New cstate: current_term: 1 leader_uuid: "cff35d921307473a859ffb6330338533" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:31.291838 32741 ts_tablet_manager.cc:933] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Initiating tablet copy from peer cff35d921307473a859ffb6330338533 (127.28.177.129:40101)
I20260812 06:36:31.292651 32741 tablet_copy_client.cc:323] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: tablet copy: Beginning tablet copy session from remote peer at address 127.28.177.129:40101
I20260812 06:36:31.296626 32367 tablet_copy_service.cc:140] P cff35d921307473a859ffb6330338533: Received BeginTabletCopySession request for tablet 362acbebb1754578806ecc0b478eabc6 from peer 84d660d9d4aa489b8ece72d1bdd440fc ({username='slave'} at 127.28.177.131:51245)
I20260812 06:36:31.296757 32367 tablet_copy_service.cc:161] P cff35d921307473a859ffb6330338533: Beginning new tablet copy session on tablet 362acbebb1754578806ecc0b478eabc6 from peer 84d660d9d4aa489b8ece72d1bdd440fc at {username='slave'} at 127.28.177.131:51245: session id = 84d660d9d4aa489b8ece72d1bdd440fc-362acbebb1754578806ecc0b478eabc6
I20260812 06:36:31.297897 32367 tablet_copy_source_session.cc:215] T 362acbebb1754578806ecc0b478eabc6 P cff35d921307473a859ffb6330338533: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:31.299147 32741 ts_tablet_manager.cc:1916] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:31.301200 32741 ts_tablet_manager.cc:1929] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.3
I20260812 06:36:31.301411 32741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362acbebb1754578806ecc0b478eabc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:31.302523 32741 tablet_copy_client.cc:806] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:31.302767 32741 tablet_copy_client.cc:670] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:31.304611 32741 tablet_copy_client.cc:538] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:31.306079 32741 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Bootstrap starting.
I20260812 06:36:31.311466 32741 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260812 06:36:31.311817 32741 tablet_bootstrap.cc:492] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Bootstrap complete.
I20260812 06:36:31.311992 32741 ts_tablet_manager.cc:1403] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.001s
I20260812 06:36:31.312605 32741 raft_consensus.cc:359] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } }
I20260812 06:36:31.313104 32741 raft_consensus.cc:886] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Ignoring setting pending config change with OpId 1.4 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }
I20260812 06:36:31.313241 32741 raft_consensus.cc:886] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Ignoring setting pending config change with OpId 1.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } } }
I20260812 06:36:31.313459 32741 raft_consensus.cc:2962] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Ignoring commit of config change with OpId 1.4 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }
I20260812 06:36:31.313843 32741 raft_consensus.cc:2962] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Ignoring commit of config change with OpId 1.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } } }
I20260812 06:36:31.314241 32741 raft_consensus.cc:740] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d660d9d4aa489b8ece72d1bdd440fc, State: Initialized, Role: FOLLOWER
I20260812 06:36:31.314400 32741 consensus_queue.cc:260] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2cd027ad3e9d4ca0b2f1eb7fde882fe7" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 34537 } } peers { permanent_uuid: "cff35d921307473a859ffb6330338533" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40101 } } peers { permanent_uuid: "84d660d9d4aa489b8ece72d1bdd440fc" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 35861 } attrs { } }
I20260812 06:36:31.314697 32741 ts_tablet_manager.cc:1434] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc: Time spent starting tablet: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:31.315399 32367 tablet_copy_service.cc:342] P cff35d921307473a859ffb6330338533: Request end of tablet copy session 84d660d9d4aa489b8ece72d1bdd440fc-362acbebb1754578806ecc0b478eabc6 received from {username='slave'} at 127.28.177.131:51245
I20260812 06:36:31.315544 32367 tablet_copy_service.cc:434] P cff35d921307473a859ffb6330338533: ending tablet copy session 84d660d9d4aa489b8ece72d1bdd440fc-362acbebb1754578806ecc0b478eabc6 on tablet 362acbebb1754578806ecc0b478eabc6 with peer 84d660d9d4aa489b8ece72d1bdd440fc
I20260812 06:36:31.381111 32606 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:31.381120 32465 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:31.381130 32321 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 29ad13e57b6244a7b28131f2dade8b58 | 127.28.177.190:37679 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                                                 Value                                                                                                 |      Tags       |         Master
------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 master_add_server_when_underreplicated               | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 master_tombstone_evicted_tablet_replicas             | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                                                                  | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                                                                     | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                                                                  | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                                                                  | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                                                                    | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                                                                   | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.28.177.148:37327 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 2cd027ad3e9d4ca0b2f1eb7fde882fe7 | 127.28.177.130:34537 | HEALTHY | <none>   |       0        |       0
 84d660d9d4aa489b8ece72d1bdd440fc | 127.28.177.131:35861 | HEALTHY | <none>   |       0        |       0
 cff35d921307473a859ffb6330338533 | 127.28.177.129:40101 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                    |                                                                                               Value                                                                                               |      Tags       |      Tablet Server
--------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection            | false                                                                                                                                                                                             | unsafe          | all 3 server(s) checked
 ipki_server_key_size                       | 768                                                                                                                                                                                               | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets              | 127.28.177.129                                                                                                                                                                                    | experimental    | 127.28.177.129:40101
 local_ip_for_outbound_sockets              | 127.28.177.130                                                                                                                                                                                    | experimental    | 127.28.177.130:34537
 local_ip_for_outbound_sockets              | 127.28.177.131                                                                                                                                                                                    | experimental    | 127.28.177.131:35861
 never_fsync                                | true                                                                                                                                                                                              | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override            | 0                                                                                                                                                                                                 | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports           | true                                                                                                                                                                                              | unsafe          | all 3 server(s) checked
 server_dump_info_format                    | pb                                                                                                                                                                                                | hidden          | all 3 server(s) checked
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.177.129:40101
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.177.130:34537
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.177.131:35861
 tablet_inject_latency_on_apply_write_op_ms | 5000                                                                                                                                                                                              | runtime,unsafe  | 127.28.177.129:40101

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.28.177.148:37327 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 362acbebb1754578806ecc0b478eabc6 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  2cd027ad3e9d4ca0b2f1eb7fde882fe7 (127.28.177.130:34537): RUNNING
  cff35d921307473a859ffb6330338533 (127.28.177.129:40101): RUNNING [LEADER]
  84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131:35861): RUNNING
All reported replicas are:
  A = 2cd027ad3e9d4ca0b2f1eb7fde882fe7
  B = cff35d921307473a859ffb6330338533
  C = 84d660d9d4aa489b8ece72d1bdd440fc
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B*  C    | 1            | 5            | Yes
 B             | A   B*  C    | 1            | 5            | Yes
 C             | A   B   C    | 1            | 5            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 06:36:31.410524 29382 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:36:31.609025 32465 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:31.609025 32321 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 06:36:31.609570 32606 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 29ad13e57b6244a7b28131f2dade8b58 | 127.28.177.190:37679 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                                                 Value                                                                                                 |      Tags       |         Master
------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 master_add_server_when_underreplicated               | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 master_tombstone_evicted_tablet_replicas             | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                                                                  | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                                                                     | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                                                                  | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                                                                  | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                                                                    | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                                                                   | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.28.177.148:37327 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 2cd027ad3e9d4ca0b2f1eb7fde882fe7 | 127.28.177.130:34537 | HEALTHY | <none>   |       0        |       0
 84d660d9d4aa489b8ece72d1bdd440fc | 127.28.177.131:35861 | HEALTHY | <none>   |       0        |       0
 cff35d921307473a859ffb6330338533 | 127.28.177.129:40101 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                    |                                                                                               Value                                                                                               |      Tags       |      Tablet Server
--------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection            | false                                                                                                                                                                                             | unsafe          | all 3 server(s) checked
 ipki_server_key_size                       | 768                                                                                                                                                                                               | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets              | 127.28.177.129                                                                                                                                                                                    | experimental    | 127.28.177.129:40101
 local_ip_for_outbound_sockets              | 127.28.177.130                                                                                                                                                                                    | experimental    | 127.28.177.130:34537
 local_ip_for_outbound_sockets              | 127.28.177.131                                                                                                                                                                                    | experimental    | 127.28.177.131:35861
 never_fsync                                | true                                                                                                                                                                                              | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override            | 0                                                                                                                                                                                                 | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports           | true                                                                                                                                                                                              | unsafe          | all 3 server(s) checked
 server_dump_info_format                    | pb                                                                                                                                                                                                | hidden          | all 3 server(s) checked
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.177.129:40101
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.177.130:34537
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.177.131:35861
 tablet_inject_latency_on_apply_write_op_ms | 5000                                                                                                                                                                                              | runtime,unsafe  | 127.28.177.129:40101

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.28.177.148:37327 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 362acbebb1754578806ecc0b478eabc6 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  2cd027ad3e9d4ca0b2f1eb7fde882fe7 (127.28.177.130:34537): RUNNING
  cff35d921307473a859ffb6330338533 (127.28.177.129:40101): RUNNING [LEADER]
  84d660d9d4aa489b8ece72d1bdd440fc (127.28.177.131:35861): RUNNING
All reported replicas are:
  A = 2cd027ad3e9d4ca0b2f1eb7fde882fe7
  B = cff35d921307473a859ffb6330338533
  C = 84d660d9d4aa489b8ece72d1bdd440fc
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B*  C    | 1            | 5            | Yes
 B             | A   B*  C    | 1            | 5            | Yes
 C             | A   B   C    | 1            | 5            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 06:36:31.636435 29382 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:36:31.889778 32630 raft_consensus.cc:1217] T 362acbebb1754578806ecc0b478eabc6 P 84d660d9d4aa489b8ece72d1bdd440fc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5]   Dedup: 1.5->[]
I20260812 06:36:31.910313 32606 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:31.910701 32465 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:31.911792 32321 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 29ad13e57b6244a7b28131f2dade8b58 | 127.28.177.190:37679 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                                                 Value                                                                                                 |      Tags       |         Master
------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 master_add_server_when_underreplicated               | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 master_tombstone_evicted_tablet_replicas             | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                                                                  | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                                                                     | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                                                                  | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                                                                  | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                                                                    | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                                                                   | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.28.177.148:37327 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 2cd027ad3e9d4ca0b2f1eb7fde882fe7 | 127.28.177.130:34537 | HEALTHY | <none>   |       0        |       0
 84d660d9d4aa489b8ece72d1bdd440fc | 127.28.177.131:35861 | HEALTHY | <none>   |       0        |       0
 cff35d921307473a859ffb6330338533 | 127.28.177.129:40101 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                    |                                                                                               Value                                                                                               |      Tags       |      Tablet Server
--------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection            | false                                                                                                                                                                                             | unsafe          | all 3 server(s) checked
 ipki_server_key_size                       | 768                                                                                                                                                                                               | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets              | 127.28.177.129                                                                                                                                                                                    | experimental    | 127.28.177.129:40101
 local_ip_for_outbound_sockets              | 127.28.177.130                                                                                                                                                                                    | experimental    | 127.28.177.130:34537
 local_ip_for_outbound_sockets              | 127.28.177.131                                                                                                                                                                                    | experimental    | 127.28.177.131:35861
 never_fsync                                | true                                                                                                                                                                                              | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override            | 0                                                                                                                                                                                                 | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports           | true                                                                                                                                                                                              | unsafe          | all 3 server(s) checked
 server_dump_info_format                    | pb                                                                                                                                                                                                | hidden          | all 3 server(s) checked
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.177.129:40101
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.177.130:34537
 server_dump_info_path                      | /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.177.131:35861
 tablet_inject_latency_on_apply_write_op_ms | 5000                                                                                                                                                                                              | runtime,unsafe  | 127.28.177.129:40101

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.28.177.148:37327 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 06:36:31.936828 29382 log_verifier.cc:126] Checking tablet 362acbebb1754578806ecc0b478eabc6
I20260812 06:36:31.963460 29382 log_verifier.cc:177] Verified matching terms for 5 ops in tablet 362acbebb1754578806ecc0b478eabc6
W20260812 06:36:32.475409 29382 scanner-internal.cc:458] Time spent opening tablet: real 0.504s	user 0.001s	sys 0.001s
I20260812 06:36:35.707909 32732 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:50920 (request call id 9) took 5003 ms. Trace:
I20260812 06:36:35.708026 32732 rpcz_store.cc:276] 0812 06:36:30.704017 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:36:30.704092 (+    75us) service_pool.cc:224] Handling call
0812 06:36:35.707887 (+5003795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 06:36:30.704473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 362acbebb1754578806ecc0b478eabc6
0812 06:36:30.704572 (+    99us) write_op.cc:432] Acquiring schema lock in shared mode
0812 06:36:30.704583 (+    11us) write_op.cc:435] Acquired schema lock
0812 06:36:30.704584 (+     1us) tablet.cc:662] Decoding operations
0812 06:36:30.704659 (+    75us) write_op.cc:620] Acquiring the partition lock for write op
0812 06:36:30.704667 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 06:36:30.704670 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 06:36:30.704703 (+    33us) tablet.cc:701] Row locks acquired
0812 06:36:30.704704 (+     1us) write_op.cc:260] PREPARE: finished
0812 06:36:30.704733 (+    29us) write_op.cc:270] Start()
0812 06:36:30.704759 (+    26us) write_op.cc:276] Timestamp: P: 1786516590704707 usec, L: 0
0812 06:36:30.704763 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 06:36:30.704885 (+   122us) log.cc:844] Serialized 171 byte log entry
0812 06:36:30.706850 (+  1965us) op_driver.cc:464] REPLICATION: finished
0812 06:36:30.707068 (+   218us) write_op.cc:301] APPLY: starting
0812 06:36:30.707071 (+     3us) write_op.cc:306] Injecting 5000ms of latency due to --tablet_inject_latency_on_apply_write_op_ms
0812 06:36:35.707324 (+5000253us) tablet.cc:1367] starting BulkCheckPresence
0812 06:36:35.707366 (+    42us) tablet.cc:1370] finished BulkCheckPresence
0812 06:36:35.707367 (+     1us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 06:36:35.707464 (+    97us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 06:36:35.707508 (+    44us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 06:36:35.707512 (+     4us) write_op.cc:312] APPLY: finished
0812 06:36:35.707601 (+    89us) log.cc:844] Serialized 22 byte log entry
0812 06:36:35.707816 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0812 06:36:35.707831 (+    15us) write_op.cc:454] Released schema lock
0812 06:36:35.707837 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":167,"mutex_wait_us":21,"num_ops":1,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":536,"prepare.run_wall_time_us":537,"raft.queue_time_us":121,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":294,"replication_time_us":2063,"spinlock_wait_cycles":58752,"thread_start_us":113,"threads_started":1,"wal-append.queue_time_us":274}]]}
I20260812 06:36:35.709569 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 32255
I20260812 06:36:35.720320 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 32397
I20260812 06:36:35.729239 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 32539
I20260812 06:36:35.738865 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 32159
2026-08-12T06:36:35Z chronyd exiting
[       OK ] TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits (6566 ms)
[----------] 4 tests from TabletReplacementITest (26304 ms total)

[----------] 2 tests from EvictAndReplaceDeadFollowerITest
[ RUN      ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/0
2026-08-12T06:36:35Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:35Z Disabled control of system clock
I20260812 06:36:35.773281 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:34683
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:34683
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 06:36:35.876108   377 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:35.876327   377 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:35.876364   377 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:35.879631   377 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:35.879716   377 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:35.879739   377 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:35.879791   377 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:35.879840   377 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:35.883644   377 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:34683
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:34683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:35.884728   377 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:35.885854   377 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:35.891798   386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:35.891871   377 server_base.cc:1061] running on GCE node
W20260812 06:36:35.891808   382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:35.891804   383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:35.892650   377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:35.893519   377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:35.894675   377 hybrid_clock.cc:648] HybridClock initialized: now 1786516595894662 us; error 33 us; skew 500 ppm
I20260812 06:36:35.896458   377 webserver.cc:533] Webserver started at http://127.28.177.190:45981/ using document root <none> and password file <none>
I20260812 06:36:35.897027   377 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:35.897083   377 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:35.897338   377 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:35.898841   377 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "7e23523996a04cdd9e3f321e3847d28a"
format_stamp: "Formatted at 2026-08-12 06:36:35 on dist-test-slave-cbbz"
I20260812 06:36:35.899266   377 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "7e23523996a04cdd9e3f321e3847d28a"
format_stamp: "Formatted at 2026-08-12 06:36:35 on dist-test-slave-cbbz"
I20260812 06:36:35.902470   377 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20260812 06:36:35.904455   393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:35.905418   377 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:35.905537   377 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "7e23523996a04cdd9e3f321e3847d28a"
format_stamp: "Formatted at 2026-08-12 06:36:35 on dist-test-slave-cbbz"
I20260812 06:36:35.905628   377 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:35.921236   377 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:35.921834   377 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:35.922022   377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:35.929217   377 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:34683
I20260812 06:36:35.929226   451 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:34683 every 8 connection(s)
I20260812 06:36:35.930183   377 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:35.932931   453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:35.937817   453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a: Bootstrap starting.
I20260812 06:36:35.938172 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 377
I20260812 06:36:35.938261 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:35.940279   453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:35.940989   453 log.cc:826] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:35.942530   453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a: No bootstrap required, opened a new log
I20260812 06:36:35.945133   453 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e23523996a04cdd9e3f321e3847d28a" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 34683 } }
I20260812 06:36:35.945385   453 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:35.945463   453 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e23523996a04cdd9e3f321e3847d28a, State: Initialized, Role: FOLLOWER
I20260812 06:36:35.945853   453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e23523996a04cdd9e3f321e3847d28a" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 34683 } }
I20260812 06:36:35.946008   453 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:35.946099   453 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:35.946244   453 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:35.946995   453 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e23523996a04cdd9e3f321e3847d28a" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 34683 } }
I20260812 06:36:35.947355   453 leader_election.cc:304] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e23523996a04cdd9e3f321e3847d28a; no voters: 
I20260812 06:36:35.947634   453 leader_election.cc:290] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:35.947748   460 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:35.948006   460 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [term 1 LEADER]: Becoming Leader. State: Replica: 7e23523996a04cdd9e3f321e3847d28a, State: Running, Role: LEADER
I20260812 06:36:35.948342   460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e23523996a04cdd9e3f321e3847d28a" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 34683 } }
I20260812 06:36:35.948747   453 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:35.949810   462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e23523996a04cdd9e3f321e3847d28a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e23523996a04cdd9e3f321e3847d28a" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 34683 } } }
I20260812 06:36:35.949995   462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:35.950385   463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e23523996a04cdd9e3f321e3847d28a. Latest consensus state: current_term: 1 leader_uuid: "7e23523996a04cdd9e3f321e3847d28a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e23523996a04cdd9e3f321e3847d28a" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 34683 } } }
I20260812 06:36:35.950487   463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:35.951370   471 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:35.953876   471 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:35.958874   471 catalog_manager.cc:1383] Generated new cluster ID: 84899f5e85924b69bf8221315a27cf49
I20260812 06:36:35.958941   471 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:35.975831   471 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:35.976958   471 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:35.985579   471 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 7e23523996a04cdd9e3f321e3847d28a: Generated new TSK 0
I20260812 06:36:35.986230   471 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:35.998721 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:34683
--builtin_ntp_servers=127.28.177.148:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 06:36:36.106026   482 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:36.106294   482 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:36.106362   482 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:36.106439   482 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:36.109786   482 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:36.109867   482 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:36.109987   482 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:36.113960   482 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:34683
--never_fsync=true
--heap_profile_path=/tmp/kudu.482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:36.115036   482 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:36.116219   482 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:36.122570   491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:36.122586   488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:36.122673   482 server_base.cc:1061] running on GCE node
W20260812 06:36:36.122627   489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:36.123106   482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:36.123629   482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:36.124776   482 hybrid_clock.cc:648] HybridClock initialized: now 1786516596124758 us; error 30 us; skew 500 ppm
I20260812 06:36:36.126462   482 webserver.cc:533] Webserver started at http://127.28.177.129:42463/ using document root <none> and password file <none>
I20260812 06:36:36.126963   482 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:36.127017   482 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:36.127171   482 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:36.128655   482 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "2fec8bb433ae4825bf305dc6847c1d08"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.129062   482 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "2fec8bb433ae4825bf305dc6847c1d08"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.132121   482 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:36.134089   497 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.135068   482 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:36.135222   482 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "2fec8bb433ae4825bf305dc6847c1d08"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.135329   482 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:36.150055   482 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:36.150713   482 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:36.150941   482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:36.151492   482 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:36.152554   482 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:36.152628   482 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.152701   482 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:36.152745   482 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.162500   482 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:40291
I20260812 06:36:36.162526   625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:40291 every 8 connection(s)
I20260812 06:36:36.163431   482 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:36.165205 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 482
I20260812 06:36:36.165313 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:36.167596 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:34683
--builtin_ntp_servers=127.28.177.148:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
I20260812 06:36:36.172360   626 heartbeater.cc:344] Connected to a master server at 127.28.177.190:34683
I20260812 06:36:36.172631   626 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:36.173179   626 heartbeater.cc:507] Master 127.28.177.190:34683 requested a full tablet report, sending...
I20260812 06:36:36.174621   412 ts_manager.cc:194] Registered new tserver with Master: 2fec8bb433ae4825bf305dc6847c1d08 (127.28.177.129:40291)
I20260812 06:36:36.175753   412 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:58435
W20260812 06:36:36.273629   629 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:36.273829   629 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:36.273851   629 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:36.273933   629 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:36.277276   629 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:36.277336   629 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:36.277432   629 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:36.281104   629 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:34683
--never_fsync=true
--heap_profile_path=/tmp/kudu.629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:36.282168   629 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:36.283361   629 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:36.289781   634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:36.289795   637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:36.289788   635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:36.290148   629 server_base.cc:1061] running on GCE node
I20260812 06:36:36.290560   629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:36.291150   629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:36.292330   629 hybrid_clock.cc:648] HybridClock initialized: now 1786516596292303 us; error 44 us; skew 500 ppm
I20260812 06:36:36.294252   629 webserver.cc:533] Webserver started at http://127.28.177.130:34931/ using document root <none> and password file <none>
I20260812 06:36:36.294885   629 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:36.294956   629 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:36.295276   629 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:36.297128   629 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.297688   629 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.301484   629 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:36.303900   644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.305003   629 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:36.305131   629 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.305240   629 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:36.330663   629 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:36.331380   629 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:36.331586   629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:36.332262   629 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:36.333303   629 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:36.333353   629 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.333421   629 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:36.333467   629 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.342926   629 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:43081
I20260812 06:36:36.343003   770 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:43081 every 8 connection(s)
I20260812 06:36:36.343930   629 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:36.344206 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 629
I20260812 06:36:36.344321 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:36.346791 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:34683
--builtin_ntp_servers=127.28.177.148:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
I20260812 06:36:36.356585   771 heartbeater.cc:344] Connected to a master server at 127.28.177.190:34683
I20260812 06:36:36.356853   771 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:36.357314   771 heartbeater.cc:507] Master 127.28.177.190:34683 requested a full tablet report, sending...
I20260812 06:36:36.358402   412 ts_manager.cc:194] Registered new tserver with Master: 4eb1f1a8f4bd4b04ac5f59ae1265934a (127.28.177.130:43081)
I20260812 06:36:36.359244   412 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:38337
W20260812 06:36:36.455175   775 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:36.455399   775 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:36.455421   775 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:36.455461   775 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:36.458897   775 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:36.458953   775 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:36.459017   775 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:36.462760   775 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:34683
--never_fsync=true
--heap_profile_path=/tmp/kudu.775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:36.463752   775 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:36.464843   775 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:36.470927   781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:36.470988   782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:36.471055   775 server_base.cc:1061] running on GCE node
W20260812 06:36:36.470954   784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:36.471513   775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:36.472067   775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:36.473273   775 hybrid_clock.cc:648] HybridClock initialized: now 1786516596473261 us; error 34 us; skew 500 ppm
I20260812 06:36:36.474993   775 webserver.cc:533] Webserver started at http://127.28.177.131:36717/ using document root <none> and password file <none>
I20260812 06:36:36.475558   775 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:36.475643   775 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:36.475864   775 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:36.477417   775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "68b8c0eb33214eec99c59181b667966d"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.477909   775 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "68b8c0eb33214eec99c59181b667966d"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.481299   775 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:36:36.483546   790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.484647   775 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:36.484778   775 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "68b8c0eb33214eec99c59181b667966d"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:36.484881   775 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:36.501154   775 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:36.501820   775 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:36.502014   775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:36.502737   775 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:36.503924   775 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:36.503998   775 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.504063   775 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:36.504093   775 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:36.513447   775 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:37447
I20260812 06:36:36.513504   918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:37447 every 8 connection(s)
I20260812 06:36:36.514426   775 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:36.522238   919 heartbeater.cc:344] Connected to a master server at 127.28.177.190:34683
I20260812 06:36:36.522466   919 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:36.522866   919 heartbeater.cc:507] Master 127.28.177.190:34683 requested a full tablet report, sending...
I20260812 06:36:36.523451 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 775
I20260812 06:36:36.523588 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:36.523952   412 ts_manager.cc:194] Registered new tserver with Master: 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447)
I20260812 06:36:36.524686   412 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:49453
I20260812 06:36:36.526021 29382 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:36.542100   412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49920:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:36:36.560659   697 tablet_service.cc:1511] Processing CreateTablet for tablet 325db855a37c4a6eb18dca7bb3f4c051 (DEFAULT_TABLE table=test-workload [id=d0ed3bc0f42d4f5da18d780ff758943a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:36.560665   551 tablet_service.cc:1511] Processing CreateTablet for tablet 325db855a37c4a6eb18dca7bb3f4c051 (DEFAULT_TABLE table=test-workload [id=d0ed3bc0f42d4f5da18d780ff758943a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:36.560665   844 tablet_service.cc:1511] Processing CreateTablet for tablet 325db855a37c4a6eb18dca7bb3f4c051 (DEFAULT_TABLE table=test-workload [id=d0ed3bc0f42d4f5da18d780ff758943a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:36.561537   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325db855a37c4a6eb18dca7bb3f4c051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.561563   844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325db855a37c4a6eb18dca7bb3f4c051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.561563   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325db855a37c4a6eb18dca7bb3f4c051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.566310   945 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: Bootstrap starting.
I20260812 06:36:36.567696   947 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Bootstrap starting.
I20260812 06:36:36.568476   946 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Bootstrap starting.
I20260812 06:36:36.568718   945 tablet_bootstrap.cc:654] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:36.569454   945 log.cc:826] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:36.569824   947 tablet_bootstrap.cc:654] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:36.570637   946 tablet_bootstrap.cc:654] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:36.570700   947 log.cc:826] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:36.571065   945 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: No bootstrap required, opened a new log
I20260812 06:36:36.571314   945 ts_tablet_manager.cc:1403] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:36.571453   946 log.cc:826] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:36.572428   947 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: No bootstrap required, opened a new log
I20260812 06:36:36.572620   947 ts_tablet_manager.cc:1403] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:36.573067   946 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: No bootstrap required, opened a new log
I20260812 06:36:36.573241   946 ts_tablet_manager.cc:1403] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:36.574105   945 raft_consensus.cc:359] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.574430   945 raft_consensus.cc:740] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eb1f1a8f4bd4b04ac5f59ae1265934a, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.574753   945 consensus_queue.cc:260] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.575397   771 heartbeater.cc:499] Master 127.28.177.190:34683 was elected leader, sending a full tablet report...
I20260812 06:36:36.575474   947 raft_consensus.cc:359] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.575687   947 raft_consensus.cc:740] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fec8bb433ae4825bf305dc6847c1d08, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.575995   947 consensus_queue.cc:260] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.576020   946 raft_consensus.cc:359] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.576301   946 raft_consensus.cc:740] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68b8c0eb33214eec99c59181b667966d, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.576687   945 ts_tablet_manager.cc:1434] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:36.576646   946 consensus_queue.cc:260] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.576911   947 ts_tablet_manager.cc:1434] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:36.577263   626 heartbeater.cc:499] Master 127.28.177.190:34683 was elected leader, sending a full tablet report...
I20260812 06:36:36.577288   919 heartbeater.cc:499] Master 127.28.177.190:34683 was elected leader, sending a full tablet report...
I20260812 06:36:36.577420   946 ts_tablet_manager.cc:1434] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
W20260812 06:36:36.594959   773 tablet.cc:2406] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:36.600283   575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "325db855a37c4a6eb18dca7bb3f4c051"
dest_uuid: "2fec8bb433ae4825bf305dc6847c1d08"
 from {username='slave'} at 127.0.0.1:34472
I20260812 06:36:36.600492   575 raft_consensus.cc:493] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:36.600642   575 raft_consensus.cc:3060] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:36.601549   575 raft_consensus.cc:515] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.602535   575 leader_election.cc:290] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [CANDIDATE]: Term 1 election: Requested vote from peers 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447), 4eb1f1a8f4bd4b04ac5f59ae1265934a (127.28.177.130:43081)
I20260812 06:36:36.605736 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:36:36.606500   867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325db855a37c4a6eb18dca7bb3f4c051" candidate_uuid: "2fec8bb433ae4825bf305dc6847c1d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "68b8c0eb33214eec99c59181b667966d"
I20260812 06:36:36.606719   867 raft_consensus.cc:3060] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:36.607317   718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325db855a37c4a6eb18dca7bb3f4c051" candidate_uuid: "2fec8bb433ae4825bf305dc6847c1d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a"
I20260812 06:36:36.607508   718 raft_consensus.cc:3060] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:36.607898   867 raft_consensus.cc:2468] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec8bb433ae4825bf305dc6847c1d08 in term 1.
I20260812 06:36:36.608364   498 leader_election.cc:304] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fec8bb433ae4825bf305dc6847c1d08, 68b8c0eb33214eec99c59181b667966d; no voters: 
I20260812 06:36:36.608654   952 raft_consensus.cc:2804] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:36.608883   952 raft_consensus.cc:697] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 1 LEADER]: Becoming Leader. State: Replica: 2fec8bb433ae4825bf305dc6847c1d08, State: Running, Role: LEADER
I20260812 06:36:36.609252   952 consensus_queue.cc:237] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:36.610899   718 raft_consensus.cc:2468] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fec8bb433ae4825bf305dc6847c1d08 in term 1.
I20260812 06:36:36.612517   411 catalog_manager.cc:5719] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fec8bb433ae4825bf305dc6847c1d08 (127.28.177.129). New cstate: current_term: 1 leader_uuid: "2fec8bb433ae4825bf305dc6847c1d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } }
W20260812 06:36:36.664535   627 tablet.cc:2406] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:36.708700 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
W20260812 06:36:36.765398   920 tablet.cc:2406] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:36.911836 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
I20260812 06:36:37.064473   952 consensus_queue.cc:1048] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:37.070581   957 consensus_queue.cc:1048] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:37.214844 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 775
W20260812 06:36:37.615159   498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.131:37447: connect: Connection refused (error 111)
W20260812 06:36:37.616715   498 consensus_peers.cc:597] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 -> Peer 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447): Couldn't send request to peer 68b8c0eb33214eec99c59181b667966d. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:37447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:40.189033   498 consensus_peers.cc:597] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 -> Peer 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447): Couldn't send request to peer 68b8c0eb33214eec99c59181b667966d. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:37447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 06:36:42.314148   981 raft_consensus.cc:1012] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08: Attempting to remove follower 68b8c0eb33214eec99c59181b667966d from the Raft config. Reason: Leader has been unable to successfully communicate with peer 68b8c0eb33214eec99c59181b667966d for more than 5 seconds (5.240s)
I20260812 06:36:42.315049   981 consensus_queue.cc:237] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:42.316370   718 raft_consensus.cc:1275] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 1 FOLLOWER]: Refusing update from remote peer 2fec8bb433ae4825bf305dc6847c1d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:42.316811   957 consensus_queue.cc:1048] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:36:42.318733   981 raft_consensus.cc:2955] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 68b8c0eb33214eec99c59181b667966d (127.28.177.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } }
I20260812 06:36:42.319267   718 raft_consensus.cc:2955] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 68b8c0eb33214eec99c59181b667966d (127.28.177.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } }
I20260812 06:36:42.321677   411 catalog_manager.cc:5719] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 reported cstate change: config changed from index -1 to 2, VOTER 68b8c0eb33214eec99c59181b667966d (127.28.177.131) evicted. New cstate: current_term: 1 leader_uuid: "2fec8bb433ae4825bf305dc6847c1d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } }
W20260812 06:36:42.325282   394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.131:37447: connect: Connection refused (error 111)
I20260812 06:36:42.325811   575 consensus_queue.cc:237] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } }
W20260812 06:36:42.326273   394 catalog_manager.cc:4777] TS 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 325db855a37c4a6eb18dca7bb3f4c051: Network error: Client connection negotiation failed: client connection to 127.28.177.131:37447: connect: Connection refused (error 111)
I20260812 06:36:42.327394   718 raft_consensus.cc:1275] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 1 FOLLOWER]: Refusing update from remote peer 2fec8bb433ae4825bf305dc6847c1d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:36:42.327795   957 consensus_queue.cc:1048] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260812 06:36:42.327973   498 consensus_peers.cc:597] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 -> Peer 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447): Couldn't send request to peer 68b8c0eb33214eec99c59181b667966d. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.131:37447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:42.329361   981 raft_consensus.cc:2955] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 68b8c0eb33214eec99c59181b667966d (127.28.177.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } }
I20260812 06:36:42.329839   718 raft_consensus.cc:2955] T 325db855a37c4a6eb18dca7bb3f4c051 P 4eb1f1a8f4bd4b04ac5f59ae1265934a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 68b8c0eb33214eec99c59181b667966d (127.28.177.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } }
I20260812 06:36:42.331285   396 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 325db855a37c4a6eb18dca7bb3f4c051 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260812 06:36:42.331974   411 catalog_manager.cc:5719] T 325db855a37c4a6eb18dca7bb3f4c051 P 2fec8bb433ae4825bf305dc6847c1d08 reported cstate change: config changed from index 2 to 3, VOTER 68b8c0eb33214eec99c59181b667966d (127.28.177.131) added. New cstate: current_term: 1 leader_uuid: "2fec8bb433ae4825bf305dc6847c1d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } } peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } }
I20260812 06:36:42.335259 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:37447
--local_ip_for_outbound_sockets=127.28.177.131
--tserver_master_addrs=127.28.177.190:34683
--webserver_port=36717
--webserver_interface=127.28.177.131
--builtin_ntp_servers=127.28.177.148:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 06:36:42.439569   992 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:42.439844   992 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:42.439918   992 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:42.439994   992 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:42.443486   992 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:42.443547   992 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:42.443612   992 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:42.447302   992 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:37447
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=36717
--tserver_master_addrs=127.28.177.190:34683
--never_fsync=true
--heap_profile_path=/tmp/kudu.992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:42.448361   992 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:42.449410   992 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:42.456290   998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:42.456399   992 server_base.cc:1061] running on GCE node
W20260812 06:36:42.456291   997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:42.456281  1000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:42.456909   992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:42.457449   992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:42.458603   992 hybrid_clock.cc:648] HybridClock initialized: now 1786516602458590 us; error 32 us; skew 500 ppm
I20260812 06:36:42.460352   992 webserver.cc:533] Webserver started at http://127.28.177.131:36717/ using document root <none> and password file <none>
I20260812 06:36:42.460915   992 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:42.461009   992 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:42.464083   992 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:42.465910  1006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:42.466784   992 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:42.466913   992 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "68b8c0eb33214eec99c59181b667966d"
format_stamp: "Formatted at 2026-08-12 06:36:36 on dist-test-slave-cbbz"
I20260812 06:36:42.467278   992 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:42.482466   992 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:42.483023   992 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:42.483218   992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:42.483744   992 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:42.484920  1014 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:36:42.487975   992 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:36:42.488054   992 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.003s	user 0.000s	sys 0.000s
I20260812 06:36:42.488130   992 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:36:42.489559   992 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:36:42.489630   992 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:36:42.489961  1014 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Bootstrap starting.
I20260812 06:36:42.501205   992 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:37447
I20260812 06:36:42.501266  1134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:37447 every 8 connection(s)
I20260812 06:36:42.502265   992 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:42.505522  1014 log.cc:826] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:42.508123  1014 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:42.508569  1014 tablet_bootstrap.cc:492] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Bootstrap complete.
I20260812 06:36:42.509995  1014 ts_tablet_manager.cc:1403] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260812 06:36:42.511653 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 992
I20260812 06:36:42.512246 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 482
I20260812 06:36:42.515825  1014 raft_consensus.cc:359] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:42.516285  1014 raft_consensus.cc:740] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68b8c0eb33214eec99c59181b667966d, State: Initialized, Role: FOLLOWER
I20260812 06:36:42.516601  1014 consensus_queue.cc:260] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68b8c0eb33214eec99c59181b667966d" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37447 } } peers { permanent_uuid: "4eb1f1a8f4bd4b04ac5f59ae1265934a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 43081 } } peers { permanent_uuid: "2fec8bb433ae4825bf305dc6847c1d08" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40291 } }
I20260812 06:36:42.517691  1014 ts_tablet_manager.cc:1434] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260812 06:36:42.528097  1135 heartbeater.cc:344] Connected to a master server at 127.28.177.190:34683
I20260812 06:36:42.528383  1135 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:42.528909  1135 heartbeater.cc:507] Master 127.28.177.190:34683 requested a full tablet report, sending...
I20260812 06:36:42.529470  1062 tablet_service.cc:1558] Processing DeleteTablet for tablet 325db855a37c4a6eb18dca7bb3f4c051 with delete_type TABLET_DATA_TOMBSTONED (TS 68b8c0eb33214eec99c59181b667966d not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:49628
I20260812 06:36:42.530288  1142 tablet_replica.cc:333] stopping tablet replica
I20260812 06:36:42.530579  1142 raft_consensus.cc:2243] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:42.530877  1142 raft_consensus.cc:2272] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:42.531016   409 ts_manager.cc:194] Re-registered known tserver with Master: 68b8c0eb33214eec99c59181b667966d (127.28.177.131:37447)
I20260812 06:36:42.532106   409 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:58833
I20260812 06:36:42.533013  1142 ts_tablet_manager.cc:1916] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:42.534098 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 629
I20260812 06:36:42.534304  1135 heartbeater.cc:499] Master 127.28.177.190:34683 was elected leader, sending a full tablet report...
I20260812 06:36:42.542554 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 992
I20260812 06:36:42.542644  1142 ts_tablet_manager.cc:1929] T 325db855a37c4a6eb18dca7bb3f4c051 P 68b8c0eb33214eec99c59181b667966d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 06:36:42.550096 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 377
2026-08-12T06:36:42Z chronyd exiting
[       OK ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/0 (6809 ms)
[ RUN      ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/1
2026-08-12T06:36:42Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:42Z Disabled control of system clock
I20260812 06:36:42.582825 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:36831
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:36831
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--raft_prepare_replacement_before_eviction=true with env {}
W20260812 06:36:42.693213  1146 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:42.693410  1146 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:42.693446  1146 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:42.696720  1146 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:42.696774  1146 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:42.696794  1146 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:42.696811  1146 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:42.700594  1146 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:36831
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:36831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:42.701601  1146 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:42.702741  1146 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:42.707881  1152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:42.707893  1151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:42.707885  1154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:42.708186  1146 server_base.cc:1061] running on GCE node
I20260812 06:36:42.708731  1146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:42.709527  1146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:42.710729  1146 hybrid_clock.cc:648] HybridClock initialized: now 1786516602710705 us; error 40 us; skew 500 ppm
I20260812 06:36:42.712478  1146 webserver.cc:533] Webserver started at http://127.28.177.190:35771/ using document root <none> and password file <none>
I20260812 06:36:42.713054  1146 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:42.713142  1146 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:42.713363  1146 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:42.714856  1146 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "831b6ac54ce54867a6903cfced510a28"
format_stamp: "Formatted at 2026-08-12 06:36:42 on dist-test-slave-cbbz"
I20260812 06:36:42.715335  1146 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "831b6ac54ce54867a6903cfced510a28"
format_stamp: "Formatted at 2026-08-12 06:36:42 on dist-test-slave-cbbz"
I20260812 06:36:42.718523  1146 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 06:36:42.720535  1160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:42.721469  1146 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:42.721602  1146 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "831b6ac54ce54867a6903cfced510a28"
format_stamp: "Formatted at 2026-08-12 06:36:42 on dist-test-slave-cbbz"
I20260812 06:36:42.721706  1146 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:42.737426  1146 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:42.738062  1146 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:42.738253  1146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:42.746263  1225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:36831 every 8 connection(s)
I20260812 06:36:42.746260  1146 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:36831
I20260812 06:36:42.747256  1146 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:42.747989 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 1146
I20260812 06:36:42.748109 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:42.750698  1226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:42.755653  1226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28: Bootstrap starting.
I20260812 06:36:42.758029  1226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:42.758697  1226 log.cc:826] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:42.760200  1226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28: No bootstrap required, opened a new log
I20260812 06:36:42.762670  1226 raft_consensus.cc:359] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831b6ac54ce54867a6903cfced510a28" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36831 } }
I20260812 06:36:42.762832  1226 raft_consensus.cc:385] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:42.762874  1226 raft_consensus.cc:740] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831b6ac54ce54867a6903cfced510a28, State: Initialized, Role: FOLLOWER
I20260812 06:36:42.763237  1226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831b6ac54ce54867a6903cfced510a28" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36831 } }
I20260812 06:36:42.763351  1226 raft_consensus.cc:399] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:42.763393  1226 raft_consensus.cc:493] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:42.763466  1226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:42.764181  1226 raft_consensus.cc:515] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831b6ac54ce54867a6903cfced510a28" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36831 } }
I20260812 06:36:42.764467  1226 leader_election.cc:304] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 831b6ac54ce54867a6903cfced510a28; no voters: 
I20260812 06:36:42.764688  1226 leader_election.cc:290] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:42.764827  1231 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:42.765057  1231 raft_consensus.cc:697] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [term 1 LEADER]: Becoming Leader. State: Replica: 831b6ac54ce54867a6903cfced510a28, State: Running, Role: LEADER
I20260812 06:36:42.765370  1231 consensus_queue.cc:237] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831b6ac54ce54867a6903cfced510a28" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36831 } }
I20260812 06:36:42.765743  1226 sys_catalog.cc:565] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:42.766945  1232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "831b6ac54ce54867a6903cfced510a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831b6ac54ce54867a6903cfced510a28" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36831 } } }
I20260812 06:36:42.767058  1232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:42.767438  1240 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:42.767426  1233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 831b6ac54ce54867a6903cfced510a28. Latest consensus state: current_term: 1 leader_uuid: "831b6ac54ce54867a6903cfced510a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831b6ac54ce54867a6903cfced510a28" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36831 } } }
I20260812 06:36:42.767542  1233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:42.770485  1240 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:42.775669  1240 catalog_manager.cc:1383] Generated new cluster ID: 4561728175af499f96183db4c204cf57
I20260812 06:36:42.775743  1240 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:42.784009  1240 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:42.784731  1240 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:42.803586  1240 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 831b6ac54ce54867a6903cfced510a28: Generated new TSK 0
I20260812 06:36:42.804261  1240 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:42.813705 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--builtin_ntp_servers=127.28.177.148:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
W20260812 06:36:42.920246  1252 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:42.920485  1252 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:42.920557  1252 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:42.920661  1252 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:42.923938  1252 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:42.924093  1252 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:42.927976  1252 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--never_fsync=true
--heap_profile_path=/tmp/kudu.1252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:42.929033  1252 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:42.930141  1252 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:42.936405  1257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:42.936405  1258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:42.936391  1260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:42.937119  1252 server_base.cc:1061] running on GCE node
I20260812 06:36:42.937475  1252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:42.937980  1252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:42.939165  1252 hybrid_clock.cc:648] HybridClock initialized: now 1786516602939146 us; error 36 us; skew 500 ppm
I20260812 06:36:42.941004  1252 webserver.cc:533] Webserver started at http://127.28.177.129:42743/ using document root <none> and password file <none>
I20260812 06:36:42.941566  1252 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:42.941656  1252 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:42.941870  1252 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:42.943361  1252 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "6e7d05e713a74e4f99fb119b620a43a7"
format_stamp: "Formatted at 2026-08-12 06:36:42 on dist-test-slave-cbbz"
I20260812 06:36:42.943840  1252 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "6e7d05e713a74e4f99fb119b620a43a7"
format_stamp: "Formatted at 2026-08-12 06:36:42 on dist-test-slave-cbbz"
I20260812 06:36:42.947162  1252 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:42.949375  1267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:42.950335  1252 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:42.950467  1252 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "6e7d05e713a74e4f99fb119b620a43a7"
format_stamp: "Formatted at 2026-08-12 06:36:42 on dist-test-slave-cbbz"
I20260812 06:36:42.950567  1252 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:42.968349  1252 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:42.968984  1252 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:42.969180  1252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:42.969739  1252 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:42.970793  1252 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:42.970865  1252 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:42.970933  1252 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:42.970984  1252 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:42.980513  1252 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:39505
I20260812 06:36:42.980602  1396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:39505 every 8 connection(s)
I20260812 06:36:42.981477  1252 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:42.990458  1397 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36831
I20260812 06:36:42.990626 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 1252
I20260812 06:36:42.990736 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:42.990736  1397 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:42.991220  1397 heartbeater.cc:507] Master 127.28.177.190:36831 requested a full tablet report, sending...
I20260812 06:36:42.992715  1177 ts_manager.cc:194] Registered new tserver with Master: 6e7d05e713a74e4f99fb119b620a43a7 (127.28.177.129:39505)
I20260812 06:36:42.992928 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--builtin_ntp_servers=127.28.177.148:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
I20260812 06:36:42.993888  1177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:60897
W20260812 06:36:43.096385  1400 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:43.096589  1400 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:43.096611  1400 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:43.096732  1400 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:43.100076  1400 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:43.100239  1400 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:43.103897  1400 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--never_fsync=true
--heap_profile_path=/tmp/kudu.1400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:43.104882  1400 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:43.105934  1400 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:43.112187  1410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:43.112200  1407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:43.112268  1405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:43.112394  1400 server_base.cc:1061] running on GCE node
I20260812 06:36:43.112886  1400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:43.113449  1400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:43.114634  1400 hybrid_clock.cc:648] HybridClock initialized: now 1786516603114618 us; error 33 us; skew 500 ppm
I20260812 06:36:43.116439  1400 webserver.cc:533] Webserver started at http://127.28.177.130:45235/ using document root <none> and password file <none>
I20260812 06:36:43.117013  1400 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:43.117100  1400 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:43.117324  1400 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:43.118846  1400 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "ce0013fc392a4729bc1459b69894bb1b"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.119333  1400 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "ce0013fc392a4729bc1459b69894bb1b"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.122540  1400 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 06:36:43.124692  1419 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.125615  1400 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:43.125769  1400 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "ce0013fc392a4729bc1459b69894bb1b"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.125866  1400 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:43.154184  1400 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:43.154902  1400 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:43.155097  1400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:43.155778  1400 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:43.156893  1400 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:43.156968  1400 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.157027  1400 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:43.157076  1400 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.165926  1400 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:44997
I20260812 06:36:43.165956  1548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:44997 every 8 connection(s)
I20260812 06:36:43.166886  1400 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:43.169761 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 1400
I20260812 06:36:43.169862 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:43.171993 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--builtin_ntp_servers=127.28.177.148:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
I20260812 06:36:43.176417  1549 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36831
I20260812 06:36:43.176719  1549 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:43.177201  1549 heartbeater.cc:507] Master 127.28.177.190:36831 requested a full tablet report, sending...
I20260812 06:36:43.178330  1177 ts_manager.cc:194] Registered new tserver with Master: ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997)
I20260812 06:36:43.179140  1177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:59667
W20260812 06:36:43.277128  1553 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:43.277333  1553 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:43.277354  1553 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:43.277392  1553 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:43.280684  1553 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:43.280788  1553 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:43.284467  1553 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--never_fsync=true
--heap_profile_path=/tmp/kudu.1553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:43.285416  1553 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:43.286438  1553 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:43.292438  1559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:43.292479  1561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:43.292487  1563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:43.293007  1553 server_base.cc:1061] running on GCE node
I20260812 06:36:43.293380  1553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:43.293877  1553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:43.295063  1553 hybrid_clock.cc:648] HybridClock initialized: now 1786516603295047 us; error 33 us; skew 500 ppm
I20260812 06:36:43.296815  1553 webserver.cc:533] Webserver started at http://127.28.177.131:42081/ using document root <none> and password file <none>
I20260812 06:36:43.297394  1553 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:43.297477  1553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:43.297700  1553 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:43.299181  1553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "084f35f5eaa842b4a6dc77008238a49e"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.299639  1553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "084f35f5eaa842b4a6dc77008238a49e"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.302945  1553 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 06:36:43.305140  1569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.306082  1553 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:43.306210  1553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "084f35f5eaa842b4a6dc77008238a49e"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.306306  1553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:43.321364  1553 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:43.321954  1553 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:43.322135  1553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:43.322674  1553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:43.323637  1553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:43.323709  1553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.323779  1553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:43.323832  1553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.333712  1553 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:36499
I20260812 06:36:43.333743  1696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:36499 every 8 connection(s)
I20260812 06:36:43.334606  1553 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:43.339035 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 1553
I20260812 06:36:43.339146 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:43.341572 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.132:0
--local_ip_for_outbound_sockets=127.28.177.132
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--builtin_ntp_servers=127.28.177.148:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
I20260812 06:36:43.343788  1697 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36831
I20260812 06:36:43.344053  1697 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:43.344594  1697 heartbeater.cc:507] Master 127.28.177.190:36831 requested a full tablet report, sending...
I20260812 06:36:43.345712  1177 ts_manager.cc:194] Registered new tserver with Master: 084f35f5eaa842b4a6dc77008238a49e (127.28.177.131:36499)
I20260812 06:36:43.346513  1177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:50551
W20260812 06:36:43.444566  1701 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:43.444759  1701 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:43.444782  1701 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:43.444818  1701 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:43.447953  1701 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:43.448046  1701 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.132
I20260812 06:36:43.451730  1701 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36831
--never_fsync=true
--heap_profile_path=/tmp/kudu.1701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:43.452761  1701 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:43.453787  1701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:43.460121  1707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:43.460125  1706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:43.460424  1701 server_base.cc:1061] running on GCE node
W20260812 06:36:43.460179  1709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:43.460808  1701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:43.461331  1701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:43.462512  1701 hybrid_clock.cc:648] HybridClock initialized: now 1786516603462493 us; error 36 us; skew 500 ppm
I20260812 06:36:43.464095  1701 webserver.cc:533] Webserver started at http://127.28.177.132:42319/ using document root <none> and password file <none>
I20260812 06:36:43.464720  1701 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:43.464803  1701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:43.465020  1701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:43.466576  1701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data/instance:
uuid: "7d2e6bf747744fe4b10595dc10a7ca32"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.467083  1701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance:
uuid: "7d2e6bf747744fe4b10595dc10a7ca32"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.470322  1701 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20260812 06:36:43.472378  1716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.473289  1701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 06:36:43.473418  1701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
uuid: "7d2e6bf747744fe4b10595dc10a7ca32"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:43.473512  1701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:43.486974  1701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:43.487519  1701 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:43.487708  1701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:43.488358  1701 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:43.489282  1701 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:43.489353  1701 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.489416  1701 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:43.489466  1701 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:43.498733  1701 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.132:43641
I20260812 06:36:43.498765  1852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.132:43641 every 8 connection(s)
I20260812 06:36:43.499586  1701 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
I20260812 06:36:43.507682  1853 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36831
I20260812 06:36:43.507958  1853 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:43.508003 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 1701
I20260812 06:36:43.508124 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance
I20260812 06:36:43.508522  1853 heartbeater.cc:507] Master 127.28.177.190:36831 requested a full tablet report, sending...
I20260812 06:36:43.509594  1177 ts_manager.cc:194] Registered new tserver with Master: 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132:43641)
I20260812 06:36:43.510250  1177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.132:44685
I20260812 06:36:43.510488 29382 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:36:43.526736  1177 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50676:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:36:43.544473  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 2c93e16b96d74ca98a4afa8f02a224a0 (DEFAULT_TABLE table=test-workload [id=d3e557ffd4494a2db06ab28b135cb346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:43.544477  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 2c93e16b96d74ca98a4afa8f02a224a0 (DEFAULT_TABLE table=test-workload [id=d3e557ffd4494a2db06ab28b135cb346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:43.544477  1471 tablet_service.cc:1511] Processing CreateTablet for tablet 2c93e16b96d74ca98a4afa8f02a224a0 (DEFAULT_TABLE table=test-workload [id=d3e557ffd4494a2db06ab28b135cb346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:43.545377  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93e16b96d74ca98a4afa8f02a224a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:43.545390  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93e16b96d74ca98a4afa8f02a224a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:43.545392  1471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93e16b96d74ca98a4afa8f02a224a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:43.550166  1877 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: Bootstrap starting.
I20260812 06:36:43.551203  1878 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Bootstrap starting.
I20260812 06:36:43.551676  1879 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Bootstrap starting.
I20260812 06:36:43.552779  1877 tablet_bootstrap.cc:654] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:43.553305  1878 tablet_bootstrap.cc:654] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:43.553643  1877 log.cc:826] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:43.553710  1879 tablet_bootstrap.cc:654] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:43.554072  1878 log.cc:826] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:43.554497  1879 log.cc:826] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:43.555688  1877 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: No bootstrap required, opened a new log
I20260812 06:36:43.555747  1878 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: No bootstrap required, opened a new log
I20260812 06:36:43.555897  1878 ts_tablet_manager.cc:1403] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20260812 06:36:43.555898  1877 ts_tablet_manager.cc:1403] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 06:36:43.556239  1879 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: No bootstrap required, opened a new log
I20260812 06:36:43.556449  1879 ts_tablet_manager.cc:1403] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:43.558984  1879 raft_consensus.cc:359] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.558990  1877 raft_consensus.cc:359] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.558991  1878 raft_consensus.cc:359] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.559190  1877 raft_consensus.cc:740] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e7d05e713a74e4f99fb119b620a43a7, State: Initialized, Role: FOLLOWER
I20260812 06:36:43.559190  1878 raft_consensus.cc:740] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 084f35f5eaa842b4a6dc77008238a49e, State: Initialized, Role: FOLLOWER
I20260812 06:36:43.559191  1879 raft_consensus.cc:740] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce0013fc392a4729bc1459b69894bb1b, State: Initialized, Role: FOLLOWER
I20260812 06:36:43.559489  1879 consensus_queue.cc:260] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.559512  1877 consensus_queue.cc:260] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.559511  1878 consensus_queue.cc:260] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.560382  1879 ts_tablet_manager.cc:1434] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:43.560393  1877 ts_tablet_manager.cc:1434] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:43.560393  1878 ts_tablet_manager.cc:1434] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.001s
I20260812 06:36:43.560748  1697 heartbeater.cc:499] Master 127.28.177.190:36831 was elected leader, sending a full tablet report...
I20260812 06:36:43.560748  1549 heartbeater.cc:499] Master 127.28.177.190:36831 was elected leader, sending a full tablet report...
I20260812 06:36:43.560827  1397 heartbeater.cc:499] Master 127.28.177.190:36831 was elected leader, sending a full tablet report...
W20260812 06:36:43.585794  1699 tablet.cc:2406] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:43.589136  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c93e16b96d74ca98a4afa8f02a224a0"
dest_uuid: "084f35f5eaa842b4a6dc77008238a49e"
 from {username='slave'} at 127.0.0.1:50990
I20260812 06:36:43.589337  1645 raft_consensus.cc:493] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:43.589421  1645 raft_consensus.cc:3060] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:43.590312  1645 raft_consensus.cc:515] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.591274  1645 leader_election.cc:290] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [CANDIDATE]: Term 1 election: Requested vote from peers ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997), 6e7d05e713a74e4f99fb119b620a43a7 (127.28.177.129:39505)
I20260812 06:36:43.594655 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:36:43.595990  1339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c93e16b96d74ca98a4afa8f02a224a0" candidate_uuid: "084f35f5eaa842b4a6dc77008238a49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6e7d05e713a74e4f99fb119b620a43a7"
I20260812 06:36:43.596014  1494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c93e16b96d74ca98a4afa8f02a224a0" candidate_uuid: "084f35f5eaa842b4a6dc77008238a49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ce0013fc392a4729bc1459b69894bb1b"
I20260812 06:36:43.596243  1339 raft_consensus.cc:3060] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:43.596257  1494 raft_consensus.cc:3060] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:43.597141  1339 raft_consensus.cc:2468] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 084f35f5eaa842b4a6dc77008238a49e in term 1.
I20260812 06:36:43.597163  1494 raft_consensus.cc:2468] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 084f35f5eaa842b4a6dc77008238a49e in term 1.
I20260812 06:36:43.597548  1573 leader_election.cc:304] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 084f35f5eaa842b4a6dc77008238a49e, 6e7d05e713a74e4f99fb119b620a43a7; no voters: 
I20260812 06:36:43.597800  1885 raft_consensus.cc:2804] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:43.598052  1885 raft_consensus.cc:697] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 1 LEADER]: Becoming Leader. State: Replica: 084f35f5eaa842b4a6dc77008238a49e, State: Running, Role: LEADER
I20260812 06:36:43.598347  1885 consensus_queue.cc:237] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:43.601713  1177 catalog_manager.cc:5719] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 084f35f5eaa842b4a6dc77008238a49e (127.28.177.131). New cstate: current_term: 1 leader_uuid: "084f35f5eaa842b4a6dc77008238a49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:43.668177  1550 tablet.cc:2406] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:43.697808 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
W20260812 06:36:43.733108  1398 tablet.cc:2406] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:43.901106 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
I20260812 06:36:43.982489  1885 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:43.988343  1891 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:44.204267 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 1400
W20260812 06:36:44.417497  1573 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111)
W20260812 06:36:44.418404  1573 consensus_peers.cc:597] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e -> Peer ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): Couldn't send request to peer ce0013fc392a4729bc1459b69894bb1b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:44.512257  1853 heartbeater.cc:499] Master 127.28.177.190:36831 was elected leader, sending a full tablet report...
W20260812 06:36:46.771878  1573 consensus_peers.cc:597] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e -> Peer ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): Couldn't send request to peer ce0013fc392a4729bc1459b69894bb1b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:48.893383  1573 consensus_peers.cc:597] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e -> Peer ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): Couldn't send request to peer ce0013fc392a4729bc1459b69894bb1b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 06:36:49.390220  1885 consensus_queue.cc:579] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Leader has been unable to successfully communicate with peer ce0013fc392a4729bc1459b69894bb1b for more than 5 seconds (5.402s)
I20260812 06:36:49.393543  1645 consensus_queue.cc:237] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: NON_VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: true } }
I20260812 06:36:49.395408  1339 raft_consensus.cc:1275] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Refusing update from remote peer 084f35f5eaa842b4a6dc77008238a49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 06:36:49.395799  1573 consensus_peers.cc:597] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e -> Peer ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): Couldn't send request to peer ce0013fc392a4729bc1459b69894bb1b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:49.396059  1911 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:36:49.398345  1909 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: NON_VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: true } } }
I20260812 06:36:49.398671  1339 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: NON_VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: true } } }
W20260812 06:36:49.399808  1574 consensus_peers.cc:597] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e -> Peer 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132:43641): Couldn't send request to peer 7d2e6bf747744fe4b10595dc10a7ca32. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c93e16b96d74ca98a4afa8f02a224a0. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:49.400384  1165 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 2c93e16b96d74ca98a4afa8f02a224a0 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 06:36:49.401631  1175 catalog_manager.cc:5719] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 reported cstate change: config changed from index -1 to 2, NON_VOTER 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) added. New cstate: current_term: 1 leader_uuid: "084f35f5eaa842b4a6dc77008238a49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: NON_VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: true } } }
I20260812 06:36:49.837641  1924 ts_tablet_manager.cc:933] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Initiating tablet copy from peer 084f35f5eaa842b4a6dc77008238a49e (127.28.177.131:36499)
I20260812 06:36:49.838245  1924 tablet_copy_client.cc:323] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: tablet copy: Beginning tablet copy session from remote peer at address 127.28.177.131:36499
I20260812 06:36:49.842207  1670 tablet_copy_service.cc:140] P 084f35f5eaa842b4a6dc77008238a49e: Received BeginTabletCopySession request for tablet 2c93e16b96d74ca98a4afa8f02a224a0 from peer 7d2e6bf747744fe4b10595dc10a7ca32 ({username='slave'} at 127.28.177.132:51081)
I20260812 06:36:49.842324  1670 tablet_copy_service.cc:161] P 084f35f5eaa842b4a6dc77008238a49e: Beginning new tablet copy session on tablet 2c93e16b96d74ca98a4afa8f02a224a0 from peer 7d2e6bf747744fe4b10595dc10a7ca32 at {username='slave'} at 127.28.177.132:51081: session id = 7d2e6bf747744fe4b10595dc10a7ca32-2c93e16b96d74ca98a4afa8f02a224a0
I20260812 06:36:49.843429  1670 tablet_copy_source_session.cc:215] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:49.846717  1924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93e16b96d74ca98a4afa8f02a224a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.851194  1924 tablet_copy_client.cc:806] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:49.851403  1924 tablet_copy_client.cc:670] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:49.853155  1924 tablet_copy_client.cc:538] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:49.854733  1924 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Bootstrap starting.
I20260812 06:36:49.858989  1924 log.cc:826] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:49.861346  1924 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:49.861591  1924 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Bootstrap complete.
I20260812 06:36:49.861840  1924 ts_tablet_manager.cc:1403] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Time spent bootstrapping tablet: real 0.007s	user 0.007s	sys 0.000s
I20260812 06:36:49.864446  1924 raft_consensus.cc:359] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: NON_VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: true } }
I20260812 06:36:49.864640  1924 raft_consensus.cc:740] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7d2e6bf747744fe4b10595dc10a7ca32, State: Initialized, Role: LEARNER
I20260812 06:36:49.864879  1924 consensus_queue.cc:260] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: NON_VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: true } }
I20260812 06:36:49.865535  1924 ts_tablet_manager.cc:1434] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:49.866278  1670 tablet_copy_service.cc:342] P 084f35f5eaa842b4a6dc77008238a49e: Request end of tablet copy session 7d2e6bf747744fe4b10595dc10a7ca32-2c93e16b96d74ca98a4afa8f02a224a0 received from {username='slave'} at 127.28.177.132:51081
I20260812 06:36:49.866415  1670 tablet_copy_service.cc:434] P 084f35f5eaa842b4a6dc77008238a49e: ending tablet copy session 7d2e6bf747744fe4b10595dc10a7ca32-2c93e16b96d74ca98a4afa8f02a224a0 on tablet 2c93e16b96d74ca98a4afa8f02a224a0 with peer 7d2e6bf747744fe4b10595dc10a7ca32
W20260812 06:36:49.938536  1573 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260812 06:36:50.248919  1796 raft_consensus.cc:1217] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 06:36:50.658995  1935 raft_consensus.cc:1064] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e: attempting to promote NON_VOTER 7d2e6bf747744fe4b10595dc10a7ca32 to VOTER
I20260812 06:36:50.659587  1935 consensus_queue.cc:237] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } }
I20260812 06:36:50.661186  1339 raft_consensus.cc:1275] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Refusing update from remote peer 084f35f5eaa842b4a6dc77008238a49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:36:50.661394  1796 raft_consensus.cc:1275] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 LEARNER]: Refusing update from remote peer 084f35f5eaa842b4a6dc77008238a49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:36:50.661656  1937 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:36:50.661854  1935 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260812 06:36:50.662216  1573 consensus_peers.cc:597] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e -> Peer ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): Couldn't send request to peer ce0013fc392a4729bc1459b69894bb1b. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:50.664326  1937 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
I20260812 06:36:50.664932  1796 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
I20260812 06:36:50.666376  1339 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
I20260812 06:36:50.667385  1177 catalog_manager.cc:5719] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e reported cstate change: config changed from index 2 to 3, 7d2e6bf747744fe4b10595dc10a7ca32 (127.28.177.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "084f35f5eaa842b4a6dc77008238a49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 06:36:50.671072  1645 consensus_queue.cc:237] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } }
I20260812 06:36:50.672310  1796 raft_consensus.cc:1275] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 FOLLOWER]: Refusing update from remote peer 084f35f5eaa842b4a6dc77008238a49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 06:36:50.672811  1339 raft_consensus.cc:1275] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Refusing update from remote peer 084f35f5eaa842b4a6dc77008238a49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 06:36:50.673038  1935 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:36:50.673328  1935 consensus_queue.cc:1048] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:36:50.674732  1935 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 084f35f5eaa842b4a6dc77008238a49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce0013fc392a4729bc1459b69894bb1b (127.28.177.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
I20260812 06:36:50.675163  1796 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce0013fc392a4729bc1459b69894bb1b (127.28.177.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
I20260812 06:36:50.675545  1339 raft_consensus.cc:2955] T 2c93e16b96d74ca98a4afa8f02a224a0 P 6e7d05e713a74e4f99fb119b620a43a7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ce0013fc392a4729bc1459b69894bb1b (127.28.177.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
I20260812 06:36:50.677850  1165 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet 2c93e16b96d74ca98a4afa8f02a224a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 06:36:50.677838  1175 catalog_manager.cc:5719] T 2c93e16b96d74ca98a4afa8f02a224a0 P 7d2e6bf747744fe4b10595dc10a7ca32 reported cstate change: config changed from index 3 to 4, VOTER ce0013fc392a4729bc1459b69894bb1b (127.28.177.130) evicted. New cstate: current_term: 1 leader_uuid: "084f35f5eaa842b4a6dc77008238a49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } } peers { permanent_uuid: "7d2e6bf747744fe4b10595dc10a7ca32" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 43641 } attrs { promote: false } } }
W20260812 06:36:50.680562  1162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111)
W20260812 06:36:50.681536  1162 catalog_manager.cc:4777] TS ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2c93e16b96d74ca98a4afa8f02a224a0: Network error: Client connection negotiation failed: client connection to 127.28.177.130:44997: connect: Connection refused (error 111)
I20260812 06:36:50.683949 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:44997
--local_ip_for_outbound_sockets=127.28.177.130
--tserver_master_addrs=127.28.177.190:36831
--webserver_port=45235
--webserver_interface=127.28.177.130
--builtin_ntp_servers=127.28.177.148:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
W20260812 06:36:50.791512  1949 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:50.791798  1949 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:50.791865  1949 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:50.791950  1949 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:50.795302  1949 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:50.795440  1949 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:50.799432  1949 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:44997
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=45235
--tserver_master_addrs=127.28.177.190:36831
--never_fsync=true
--heap_profile_path=/tmp/kudu.1949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:50.800621  1949 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:50.801738  1949 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:50.808482  1954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:50.808593  1957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:50.808626  1955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:50.808705  1949 server_base.cc:1061] running on GCE node
I20260812 06:36:50.809165  1949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:50.809689  1949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:50.810842  1949 hybrid_clock.cc:648] HybridClock initialized: now 1786516610810815 us; error 37 us; skew 500 ppm
I20260812 06:36:50.812646  1949 webserver.cc:533] Webserver started at http://127.28.177.130:45235/ using document root <none> and password file <none>
I20260812 06:36:50.813290  1949 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:50.813381  1949 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:50.816695  1949 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:50.818528  1964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:50.819499  1949 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:50.819643  1949 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "ce0013fc392a4729bc1459b69894bb1b"
format_stamp: "Formatted at 2026-08-12 06:36:43 on dist-test-slave-cbbz"
I20260812 06:36:50.820012  1949 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:50.851493  1949 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:50.852346  1949 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:50.852550  1949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:50.853152  1949 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:50.854406  1973 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:36:50.857828  1949 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:36:50.857901  1949 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:36:50.857998  1949 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:36:50.859400  1949 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:36:50.859469  1949 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:36:50.859846  1973 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Bootstrap starting.
I20260812 06:36:50.871210  1949 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:44997
I20260812 06:36:50.871251  2099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:44997 every 8 connection(s)
I20260812 06:36:50.872241  1949 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:50.875366  1973 log.cc:826] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:50.878113  1973 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:50.878538  1973 tablet_bootstrap.cc:492] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Bootstrap complete.
I20260812 06:36:50.879964  1973 ts_tablet_manager.cc:1403] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260812 06:36:50.880692 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 1949
I20260812 06:36:50.881229 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 1252
I20260812 06:36:50.888216  2100 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36831
I20260812 06:36:50.888425  2100 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:50.888873  2100 heartbeater.cc:507] Master 127.28.177.190:36831 requested a full tablet report, sending...
I20260812 06:36:50.890846  1182 ts_manager.cc:194] Re-registered known tserver with Master: ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997)
I20260812 06:36:50.891861  1182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:56069
I20260812 06:36:50.885538  2022 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c93e16b96d74ca98a4afa8f02a224a0 with delete_type TABLET_DATA_TOMBSTONED (TS ce0013fc392a4729bc1459b69894bb1b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44598
W20260812 06:36:50.894424  1162 catalog_manager.cc:5030] TS ce0013fc392a4729bc1459b69894bb1b (127.28.177.130:44997): delete failed for tablet 2c93e16b96d74ca98a4afa8f02a224a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c93e16b96d74ca98a4afa8f02a224a0 already in progress: opening tablet
I20260812 06:36:50.894258  1973 raft_consensus.cc:359] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:50.894739  1973 raft_consensus.cc:740] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce0013fc392a4729bc1459b69894bb1b, State: Initialized, Role: FOLLOWER
I20260812 06:36:50.895085  1973 consensus_queue.cc:260] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce0013fc392a4729bc1459b69894bb1b" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 44997 } } peers { permanent_uuid: "6e7d05e713a74e4f99fb119b620a43a7" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 39505 } } peers { permanent_uuid: "084f35f5eaa842b4a6dc77008238a49e" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 36499 } }
I20260812 06:36:50.895746  2100 heartbeater.cc:499] Master 127.28.177.190:36831 was elected leader, sending a full tablet report...
I20260812 06:36:50.896059  1973 ts_tablet_manager.cc:1434] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260812 06:36:50.897646  2022 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c93e16b96d74ca98a4afa8f02a224a0 with delete_type TABLET_DATA_TOMBSTONED (Replica has no consensus available (current committed config index is 4)) from {username='slave'} at 127.0.0.1:44598
I20260812 06:36:50.897846  2107 tablet_replica.cc:333] stopping tablet replica
I20260812 06:36:50.898128  2107 raft_consensus.cc:2243] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:50.898396  2107 raft_consensus.cc:2272] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:50.899386  2107 ts_tablet_manager.cc:1916] T 2c93e16b96d74ca98a4afa8f02a224a0 P ce0013fc392a4729bc1459b69894bb1b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:50.900537 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 1949
I20260812 06:36:50.909235 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 1553
I20260812 06:36:50.917781 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 1701
I20260812 06:36:50.926491 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 1146
2026-08-12T06:36:50Z chronyd exiting
[       OK ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/1 (8377 ms)
[----------] 2 tests from EvictAndReplaceDeadFollowerITest (15186 ms total)

[----------] 4 tests from DontEvictIfRemainingConfigIsUnstableITest
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/0
2026-08-12T06:36:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:50Z Disabled control of system clock
I20260812 06:36:50.960770 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:36313
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:34889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:36313
--raft_prepare_replacement_before_eviction=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:36:51.064296  2112 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:51.064496  2112 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:51.064535  2112 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:51.067845  2112 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:51.067909  2112 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:51.067929  2112 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:51.067948  2112 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:51.068012  2112 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:51.071827  2112 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:36313
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:36313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:51.072880  2112 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:51.073998  2112 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:51.079706  2119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.079711  2122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.079711  2118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:51.079937  2112 server_base.cc:1061] running on GCE node
I20260812 06:36:51.080634  2112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:51.081504  2112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:51.082705  2112 hybrid_clock.cc:648] HybridClock initialized: now 1786516611082683 us; error 43 us; skew 500 ppm
I20260812 06:36:51.084460  2112 webserver.cc:533] Webserver started at http://127.28.177.190:44391/ using document root <none> and password file <none>
I20260812 06:36:51.085027  2112 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:51.085119  2112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:51.085357  2112 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:51.086910  2112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.087384  2112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.090826  2112 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 06:36:51.092934  2128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.093909  2112 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:51.094039  2112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.094157  2112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:51.119866  2112 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:51.120626  2112 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:51.120846  2112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:51.128196  2112 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:36313
I20260812 06:36:51.128239  2190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:36313 every 8 connection(s)
I20260812 06:36:51.129267  2112 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:51.132042  2191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:51.136121 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2112
I20260812 06:36:51.136270 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:36:51.137171  2191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34: Bootstrap starting.
I20260812 06:36:51.139346  2191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:51.140055  2191 log.cc:826] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:51.141613  2191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34: No bootstrap required, opened a new log
I20260812 06:36:51.144389  2191 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36313 } }
I20260812 06:36:51.144582  2191 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:51.144662  2191 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa8c8eed7f644cb9ff41f0e4acffb34, State: Initialized, Role: FOLLOWER
I20260812 06:36:51.145125  2191 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36313 } }
I20260812 06:36:51.145293  2191 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:51.145361  2191 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:51.145464  2191 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:51.146175  2191 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36313 } }
I20260812 06:36:51.146503  2191 leader_election.cc:304] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6aa8c8eed7f644cb9ff41f0e4acffb34; no voters: 
I20260812 06:36:51.146775  2191 leader_election.cc:290] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:51.146890  2197 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:51.147133  2197 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [term 1 LEADER]: Becoming Leader. State: Replica: 6aa8c8eed7f644cb9ff41f0e4acffb34, State: Running, Role: LEADER
I20260812 06:36:51.147447  2197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36313 } }
I20260812 06:36:51.147871  2191 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:51.149214  2201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa8c8eed7f644cb9ff41f0e4acffb34. Latest consensus state: current_term: 1 leader_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36313 } } }
I20260812 06:36:51.149331  2200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6aa8c8eed7f644cb9ff41f0e4acffb34" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 36313 } } }
I20260812 06:36:51.149402  2201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:51.149405  2200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:51.150121  2210 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:51.152570  2210 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:51.157634  2210 catalog_manager.cc:1383] Generated new cluster ID: 106c7c0d6aaf4afd9eae0d0fc491bfa4
I20260812 06:36:51.157697  2210 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:51.168166  2210 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:51.169301  2210 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:51.182567  2210 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 6aa8c8eed7f644cb9ff41f0e4acffb34: Generated new TSK 0
I20260812 06:36:51.183171  2210 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:51.191164 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36313
--builtin_ntp_servers=127.28.177.148:34889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:36:51.297087  2220 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:51.297328  2220 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:51.297350  2220 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:51.297470  2220 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:51.300858  2220 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:51.300930  2220 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:51.301067  2220 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:36:51.305086  2220 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:36313
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.2220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:51.306234  2220 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:51.307488  2220 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:36:51.310423  2220 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:36:51.314185  2229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.314162  2227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.314167  2225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:51.314483  2220 server_base.cc:1061] running on GCE node
I20260812 06:36:51.314961  2220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:51.315569  2220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:51.316748  2220 hybrid_clock.cc:648] HybridClock initialized: now 1786516611316715 us; error 54 us; skew 500 ppm
I20260812 06:36:51.318732  2220 webserver.cc:533] Webserver started at http://127.28.177.129:33899/ using document root <none> and password file <none>
I20260812 06:36:51.319393  2220 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:51.319455  2220 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:51.319664  2220 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:51.321655  2220 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "7feba69def4743a79da9432abac3ec39"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.322206  2220 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "7feba69def4743a79da9432abac3ec39"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.326248  2220 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:51.328737  2236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.329783  2220 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:51.329878  2220 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "7feba69def4743a79da9432abac3ec39"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.329954  2220 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:51.340544  2220 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:51.341111  2220 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:51.341253  2220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:51.341748  2220 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:51.342682  2220 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:51.342729  2220 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.342767  2220 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:51.342796  2220 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.352394  2220 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:34091
I20260812 06:36:51.352484  2365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:34091 every 8 connection(s)
I20260812 06:36:51.353368  2220 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:51.357401 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2220
I20260812 06:36:51.357520 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:51.360119 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36313
--builtin_ntp_servers=127.28.177.148:34889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:36:51.363771  2367 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36313
I20260812 06:36:51.364029  2367 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:51.364530  2367 heartbeater.cc:507] Master 127.28.177.190:36313 requested a full tablet report, sending...
I20260812 06:36:51.366149  2149 ts_manager.cc:194] Registered new tserver with Master: 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091)
I20260812 06:36:51.367935  2149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:42251
W20260812 06:36:51.465540  2371 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:51.465735  2371 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:51.465755  2371 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:51.465797  2371 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:51.468940  2371 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:51.468992  2371 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:51.469082  2371 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:36:51.472903  2371 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:36313
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.2371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:51.474309  2371 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:51.475389  2371 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:36:51.478086  2371 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:36:51.481745  2381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.481698  2379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.481705  2378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:51.481951  2371 server_base.cc:1061] running on GCE node
I20260812 06:36:51.482481  2371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:51.482995  2371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:51.484211  2371 hybrid_clock.cc:648] HybridClock initialized: now 1786516611484188 us; error 30 us; skew 500 ppm
I20260812 06:36:51.485956  2371 webserver.cc:533] Webserver started at http://127.28.177.130:42729/ using document root <none> and password file <none>
I20260812 06:36:51.486503  2371 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:51.486584  2371 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:51.486799  2371 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:51.488437  2371 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "d210bad4d3ca4db6801e00ef243b73fd"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.488906  2371 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "d210bad4d3ca4db6801e00ef243b73fd"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.492331  2371 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:36:51.494338  2387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.495307  2371 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:51.495435  2371 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "d210bad4d3ca4db6801e00ef243b73fd"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.495532  2371 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:51.518136  2371 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:51.518733  2371 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:51.518914  2371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:51.519541  2371 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:51.520583  2371 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:51.520664  2371 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.520731  2371 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:51.520780  2371 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.530205  2371 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:37225
I20260812 06:36:51.530249  2510 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:37225 every 8 connection(s)
I20260812 06:36:51.531124  2371 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:51.536720 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2371
I20260812 06:36:51.536850 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:51.539072 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:36313
--builtin_ntp_servers=127.28.177.148:34889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:36:51.540638  2511 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36313
I20260812 06:36:51.540880  2511 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:51.541311  2511 heartbeater.cc:507] Master 127.28.177.190:36313 requested a full tablet report, sending...
I20260812 06:36:51.542331  2149 ts_manager.cc:194] Registered new tserver with Master: d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225)
I20260812 06:36:51.542892  2149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:49709
W20260812 06:36:51.643621  2515 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:51.643901  2515 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:51.643977  2515 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:51.644066  2515 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:51.647341  2515 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:36:51.647444  2515 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:51.647554  2515 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:36:51.651726  2515 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:36313
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.2515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:51.652881  2515 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:51.654024  2515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:36:51.656805  2515 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:36:51.660326  2520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:51.660380  2521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:51.660473  2515 server_base.cc:1061] running on GCE node
W20260812 06:36:51.660328  2523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:51.660938  2515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:51.661486  2515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:51.662667  2515 hybrid_clock.cc:648] HybridClock initialized: now 1786516611662651 us; error 42 us; skew 500 ppm
I20260812 06:36:51.664343  2515 webserver.cc:533] Webserver started at http://127.28.177.131:39437/ using document root <none> and password file <none>
I20260812 06:36:51.664902  2515 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:51.664987  2515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:51.665227  2515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:51.666723  2515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "38c94f45d0434156860df21f7d34a0f0"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.667191  2515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "38c94f45d0434156860df21f7d34a0f0"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.670392  2515 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:51.672452  2529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.673382  2515 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:51.673513  2515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "38c94f45d0434156860df21f7d34a0f0"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:36:51.673606  2515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:51.688620  2515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:51.689263  2515 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:51.689445  2515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:51.689999  2515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:51.690999  2515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:51.691074  2515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.691146  2515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:51.691205  2515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:51.700423  2515 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:44813
I20260812 06:36:51.700467  2659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:44813 every 8 connection(s)
I20260812 06:36:51.701364  2515 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:51.705865 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2515
I20260812 06:36:51.705991 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:51.710317  2661 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36313
I20260812 06:36:51.710561  2661 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:51.711031  2661 heartbeater.cc:507] Master 127.28.177.190:36313 requested a full tablet report, sending...
I20260812 06:36:51.712054  2149 ts_manager.cc:194] Registered new tserver with Master: 38c94f45d0434156860df21f7d34a0f0 (127.28.177.131:44813)
I20260812 06:36:51.712682  2149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:33333
I20260812 06:36:51.720093 29382 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:51.736353  2149 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37920:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:36:51.753710  2291 tablet_service.cc:1511] Processing CreateTablet for tablet 368394d65a674b42bda8c6c362f052dc (DEFAULT_TABLE table=test-workload [id=0b110e2e4be3488f85a0aa66a910b2d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:51.753731  2585 tablet_service.cc:1511] Processing CreateTablet for tablet 368394d65a674b42bda8c6c362f052dc (DEFAULT_TABLE table=test-workload [id=0b110e2e4be3488f85a0aa66a910b2d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:51.753731  2440 tablet_service.cc:1511] Processing CreateTablet for tablet 368394d65a674b42bda8c6c362f052dc (DEFAULT_TABLE table=test-workload [id=0b110e2e4be3488f85a0aa66a910b2d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:51.754565  2291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368394d65a674b42bda8c6c362f052dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:51.754621  2440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368394d65a674b42bda8c6c362f052dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:51.754621  2585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368394d65a674b42bda8c6c362f052dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:51.759382  2686 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Bootstrap starting.
I20260812 06:36:51.760561  2687 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: Bootstrap starting.
I20260812 06:36:51.760572  2688 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: Bootstrap starting.
I20260812 06:36:51.762236  2686 tablet_bootstrap.cc:654] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:51.762683  2688 tablet_bootstrap.cc:654] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:51.762683  2687 tablet_bootstrap.cc:654] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:51.763018  2686 log.cc:826] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:51.763496  2687 log.cc:826] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:51.763496  2688 log.cc:826] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:51.764680  2686 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: No bootstrap required, opened a new log
I20260812 06:36:51.764883  2686 ts_tablet_manager.cc:1403] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:51.765136  2688 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: No bootstrap required, opened a new log
I20260812 06:36:51.765136  2687 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: No bootstrap required, opened a new log
I20260812 06:36:51.765316  2687 ts_tablet_manager.cc:1403] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:51.765316  2688 ts_tablet_manager.cc:1403] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:51.767755  2686 raft_consensus.cc:359] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.767951  2686 raft_consensus.cc:740] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7feba69def4743a79da9432abac3ec39, State: Initialized, Role: FOLLOWER
I20260812 06:36:51.768324  2686 consensus_queue.cc:260] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.768266  2688 raft_consensus.cc:359] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.768271  2687 raft_consensus.cc:359] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.768460  2687 raft_consensus.cc:740] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d210bad4d3ca4db6801e00ef243b73fd, State: Initialized, Role: FOLLOWER
I20260812 06:36:51.768460  2688 raft_consensus.cc:740] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c94f45d0434156860df21f7d34a0f0, State: Initialized, Role: FOLLOWER
I20260812 06:36:51.768774  2687 consensus_queue.cc:260] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.768774  2688 consensus_queue.cc:260] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.768980  2367 heartbeater.cc:499] Master 127.28.177.190:36313 was elected leader, sending a full tablet report...
I20260812 06:36:51.769603  2688 ts_tablet_manager.cc:1434] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:51.769594  2687 ts_tablet_manager.cc:1434] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:51.769665  2661 heartbeater.cc:499] Master 127.28.177.190:36313 was elected leader, sending a full tablet report...
I20260812 06:36:51.770018  2511 heartbeater.cc:499] Master 127.28.177.190:36313 was elected leader, sending a full tablet report...
I20260812 06:36:51.772018  2686 ts_tablet_manager.cc:1434] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260812 06:36:51.781961  2512 tablet.cc:2406] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:51.801714  2608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368394d65a674b42bda8c6c362f052dc"
dest_uuid: "38c94f45d0434156860df21f7d34a0f0"
 from {username='slave'} at 127.0.0.1:58058
I20260812 06:36:51.801970  2608 raft_consensus.cc:493] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:51.802106  2608 raft_consensus.cc:3060] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:51.803069  2608 raft_consensus.cc:515] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.804111  2608 leader_election.cc:290] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [CANDIDATE]: Term 1 election: Requested vote from peers d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225), 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091)
I20260812 06:36:51.807209 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:36:51.808372  2462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368394d65a674b42bda8c6c362f052dc" candidate_uuid: "38c94f45d0434156860df21f7d34a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d210bad4d3ca4db6801e00ef243b73fd"
I20260812 06:36:51.808415  2314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368394d65a674b42bda8c6c362f052dc" candidate_uuid: "38c94f45d0434156860df21f7d34a0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7feba69def4743a79da9432abac3ec39"
I20260812 06:36:51.808588  2314 raft_consensus.cc:3060] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:51.808588  2462 raft_consensus.cc:3060] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:51.809806  2314 raft_consensus.cc:2468] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c94f45d0434156860df21f7d34a0f0 in term 1.
I20260812 06:36:51.809806  2462 raft_consensus.cc:2468] T 368394d65a674b42bda8c6c362f052dc P d210bad4d3ca4db6801e00ef243b73fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c94f45d0434156860df21f7d34a0f0 in term 1.
I20260812 06:36:51.810279  2532 leader_election.cc:304] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 38c94f45d0434156860df21f7d34a0f0, 7feba69def4743a79da9432abac3ec39, d210bad4d3ca4db6801e00ef243b73fd; no voters: 
I20260812 06:36:51.810618  2697 raft_consensus.cc:2804] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:51.810858  2697 raft_consensus.cc:697] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 38c94f45d0434156860df21f7d34a0f0, State: Running, Role: LEADER
I20260812 06:36:51.811185  2697 consensus_queue.cc:237] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:36:51.814390  2146 catalog_manager.cc:5719] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38c94f45d0434156860df21f7d34a0f0 (127.28.177.131). New cstate: current_term: 1 leader_uuid: "38c94f45d0434156860df21f7d34a0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } }
W20260812 06:36:51.854511  2368 tablet.cc:2406] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:51.857303  2697 consensus_queue.cc:1048] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:51.857508  2701 consensus_queue.cc:1048] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:51.911209 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2220
I20260812 06:36:51.921134 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2371
W20260812 06:36:51.943181  2533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111)
W20260812 06:36:51.944195  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:51.945379  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:52.179731  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:52.194779  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:52.438265  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:36:52.457672  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:36:52.690390  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:36:52.724078  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:36:52.934069  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 06:36:52.991636  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 06:36:53.213219  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 06:36:53.233179  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 06:36:53.461351  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 06:36:53.478690  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 06:36:53.678366  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 06:36:53.697410  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 06:36:53.916529  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 06:36:53.949160  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 06:36:54.166457  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 06:36:54.190881  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 06:36:54.427692  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 06:36:54.428035  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 06:36:54.674046  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 06:36:54.680745  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 06:36:54.945472  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 06:36:54.948604  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 06:36:55.164544  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 06:36:55.174549  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 06:36:55.397750  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 06:36:55.428249  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 06:36:55.662873  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 06:36:55.699646  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 06:36:55.899894  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 06:36:55.955078  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 06:36:56.146188  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 06:36:56.214608  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 06:36:56.381430  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 06:36:56.487257  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 06:36:56.615728  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 06:36:56.741266  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 06:36:56.852911  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 06:36:56.959224  2532 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111) [suppressed 201 similar messages]
W20260812 06:36:57.017171  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 06:36:57.096949  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 06:36:57.267486  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 06:36:57.360870  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 06:36:57.527992  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 06:36:57.618404  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 06:36:57.744206  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 06:36:57.868394  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 06:36:57.982506  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 06:36:58.139741  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 06:36:58.192330  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 06:36:58.378875  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 06:36:58.429167  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 06:36:58.635357  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 06:36:58.687752  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 06:36:58.872509  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 06:36:58.917727  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 06:36:59.134840  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 06:36:59.174788  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 06:36:59.385519  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 06:36:59.411319  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 06:36:59.639637  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 06:36:59.658157  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 06:36:59.901479  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 06:36:59.909334  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 06:37:00.135099  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 06:37:00.179116  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 06:37:00.393406  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 06:37:00.420432  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 06:37:00.624931  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 06:37:00.675487  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 06:37:00.891407  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 06:37:00.902024  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 06:37:01.123479  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 06:37:01.172533  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 06:37:01.392998  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 06:37:01.403012  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 06:37:01.625204  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 06:37:01.657246  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 06:37:01.858246  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 06:37:01.905962  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 06:37:01.965468  2533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111) [suppressed 201 similar messages]
W20260812 06:37:02.119787  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 06:37:02.126983  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 06:37:02.354357  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 06:37:02.354737  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 06:37:02.597072  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 06:37:02.607558  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 06:37:02.867568  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 06:37:02.897105  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 06:37:03.088450  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 06:37:03.135344  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 06:37:03.363515  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 06:37:03.420372  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 06:37:03.608919  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
W20260812 06:37:03.666309  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
W20260812 06:37:03.845887  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 241: this message will repeat every 5th retry.
W20260812 06:37:03.902953  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 241: this message will repeat every 5th retry.
I20260812 06:37:03.931342 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:34091
--local_ip_for_outbound_sockets=127.28.177.129
--tserver_master_addrs=127.28.177.190:36313
--webserver_port=33899
--webserver_interface=127.28.177.129
--builtin_ntp_servers=127.28.177.148:34889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:04.038043  2719 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:04.038275  2719 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:04.038296  2719 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:04.038415  2719 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:04.041682  2719 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:37:04.041742  2719 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:04.041882  2719 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:37:04.045665  2719 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:34889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:34091
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=33899
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:36313
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.2719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:04.046726  2719 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:04.047854  2719 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:04.050670  2719 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:04.054687  2725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.054664  2726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.054734  2719 server_base.cc:1061] running on GCE node
W20260812 06:37:04.054675  2728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.055276  2719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:04.055779  2719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:04.056950  2719 hybrid_clock.cc:648] HybridClock initialized: now 1786516624056928 us; error 37 us; skew 500 ppm
I20260812 06:37:04.058825  2719 webserver.cc:533] Webserver started at http://127.28.177.129:33899/ using document root <none> and password file <none>
I20260812 06:37:04.059355  2719 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:04.059427  2719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:04.063129  2719 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:04.065164  2734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.066102  2719 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:04.066228  2719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "7feba69def4743a79da9432abac3ec39"
format_stamp: "Formatted at 2026-08-12 06:36:51 on dist-test-slave-cbbz"
I20260812 06:37:04.066649  2719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:04.082144  2719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:04.082795  2719 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:04.082973  2719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:04.083536  2719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:04.084892  2741 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:04.088279  2719 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:04.088363  2719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:04.088447  2719 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:04.089974  2719 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:04.090070  2719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
W20260812 06:37:04.090281  2532 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091): Couldn't send request to peer 7feba69def4743a79da9432abac3ec39. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34091: connect: Connection refused (error 111). This is attempt 246: this message will repeat every 5th retry.
I20260812 06:37:04.090370  2741 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Bootstrap starting.
I20260812 06:37:04.103490  2719 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:34091
I20260812 06:37:04.103515  2860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:34091 every 8 connection(s)
I20260812 06:37:04.104907  2719 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:04.107841 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2719
I20260812 06:37:04.108521  2741 log.cc:826] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:04.111392  2741 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:04.111806  2741 tablet_bootstrap.cc:492] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Bootstrap complete.
I20260812 06:37:04.113276  2741 ts_tablet_manager.cc:1403] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.006s
I20260812 06:37:04.115808  2741 raft_consensus.cc:359] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:37:04.116108  2741 raft_consensus.cc:740] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7feba69def4743a79da9432abac3ec39, State: Initialized, Role: FOLLOWER
I20260812 06:37:04.116484  2741 consensus_queue.cc:260] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:37:04.117205  2741 ts_tablet_manager.cc:1434] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.001s
I20260812 06:37:04.119822  2862 heartbeater.cc:344] Connected to a master server at 127.28.177.190:36313
I20260812 06:37:04.120065  2862 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:04.120545  2862 heartbeater.cc:507] Master 127.28.177.190:36313 requested a full tablet report, sending...
I20260812 06:37:04.122316  2149 ts_manager.cc:194] Re-registered known tserver with Master: 7feba69def4743a79da9432abac3ec39 (127.28.177.129:34091)
I20260812 06:37:04.123067  2149 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:51067
I20260812 06:37:04.124769  2862 heartbeater.cc:499] Master 127.28.177.190:36313 was elected leader, sending a full tablet report...
I20260812 06:37:04.149742  2869 raft_consensus.cc:1012] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0: Attempting to remove follower d210bad4d3ca4db6801e00ef243b73fd from the Raft config. Reason: Leader has been unable to successfully communicate with peer d210bad4d3ca4db6801e00ef243b73fd for more than 3 seconds (12.244s)
I20260812 06:37:04.150619  2869 consensus_queue.cc:237] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } }
I20260812 06:37:04.151959  2810 raft_consensus.cc:1275] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Refusing update from remote peer 38c94f45d0434156860df21f7d34a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:04.152515  2716 consensus_queue.cc:1048] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:37:04.155154  2869 raft_consensus.cc:2955] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } }
I20260812 06:37:04.155681  2810 raft_consensus.cc:2955] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } }
I20260812 06:37:04.157809  2149 catalog_manager.cc:5719] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 reported cstate change: config changed from index -1 to 2, VOTER d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130) evicted. New cstate: current_term: 1 leader_uuid: "38c94f45d0434156860df21f7d34a0f0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } }
W20260812 06:37:04.161290  2132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111)
I20260812 06:37:04.161844  2608 consensus_queue.cc:237] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } }
W20260812 06:37:04.162333  2132 catalog_manager.cc:4777] TS d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 368394d65a674b42bda8c6c362f052dc: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111)
I20260812 06:37:04.163153  2810 raft_consensus.cc:1275] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Refusing update from remote peer 38c94f45d0434156860df21f7d34a0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:37:04.163532  2716 consensus_queue.cc:1048] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260812 06:37:04.163710  2533 consensus_peers.cc:597] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 -> Peer d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130:37225): Couldn't send request to peer d210bad4d3ca4db6801e00ef243b73fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.130:37225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:04.165091  2869 raft_consensus.cc:2955] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } }
I20260812 06:37:04.165541  2810 raft_consensus.cc:2955] T 368394d65a674b42bda8c6c362f052dc P 7feba69def4743a79da9432abac3ec39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } }
I20260812 06:37:04.167593  2132 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 368394d65a674b42bda8c6c362f052dc with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260812 06:37:04.167954  2149 catalog_manager.cc:5719] T 368394d65a674b42bda8c6c362f052dc P 38c94f45d0434156860df21f7d34a0f0 reported cstate change: config changed from index 2 to 3, VOTER d210bad4d3ca4db6801e00ef243b73fd (127.28.177.130) added. New cstate: current_term: 1 leader_uuid: "38c94f45d0434156860df21f7d34a0f0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7feba69def4743a79da9432abac3ec39" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34091 } } peers { permanent_uuid: "38c94f45d0434156860df21f7d34a0f0" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44813 } } peers { permanent_uuid: "d210bad4d3ca4db6801e00ef243b73fd" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 37225 } } }
I20260812 06:37:04.179680 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2719
I20260812 06:37:04.189693 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2515
I20260812 06:37:04.198366 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2112
2026-08-12T06:37:04Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/0 (13270 ms)
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/1
2026-08-12T06:37:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:04Z Disabled control of system clock
I20260812 06:37:04.231264 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:41941
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:41941
--raft_prepare_replacement_before_eviction=true
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:37:04.334745  2882 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:04.334936  2882 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:04.334975  2882 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:04.338246  2882 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:04.338311  2882 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:04.338349  2882 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:04.338366  2882 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:04.342056  2882 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:41941
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:41941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:04.343008  2882 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:04.344033  2882 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:04.349467  2889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.349522  2890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.349582  2882 server_base.cc:1061] running on GCE node
W20260812 06:37:04.349476  2892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.350188  2882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:04.351052  2882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:04.352216  2882 hybrid_clock.cc:648] HybridClock initialized: now 1786516624352196 us; error 29 us; skew 500 ppm
I20260812 06:37:04.353976  2882 webserver.cc:533] Webserver started at http://127.28.177.190:42603/ using document root <none> and password file <none>
I20260812 06:37:04.354535  2882 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:04.354619  2882 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:04.354840  2882 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:04.356423  2882 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "d12bd4c0e1524f158b1b874c3e244658"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.356911  2882 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "d12bd4c0e1524f158b1b874c3e244658"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.360234  2882 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:37:04.362332  2898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.363296  2882 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:04.363433  2882 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "d12bd4c0e1524f158b1b874c3e244658"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.363533  2882 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:04.374135  2882 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:04.374786  2882 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:04.374971  2882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:04.382347  2958 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:41941 every 8 connection(s)
I20260812 06:37:04.382357  2882 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:41941
I20260812 06:37:04.383380  2882 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:04.386229 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2882
I20260812 06:37:04.386279  2959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:04.386365 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:37:04.392791  2959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658: Bootstrap starting.
I20260812 06:37:04.395054  2959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:04.395823  2959 log.cc:826] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:04.397750  2959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658: No bootstrap required, opened a new log
I20260812 06:37:04.400559  2959 raft_consensus.cc:359] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12bd4c0e1524f158b1b874c3e244658" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41941 } }
I20260812 06:37:04.400749  2959 raft_consensus.cc:385] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:04.400807  2959 raft_consensus.cc:740] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d12bd4c0e1524f158b1b874c3e244658, State: Initialized, Role: FOLLOWER
I20260812 06:37:04.401199  2959 consensus_queue.cc:260] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12bd4c0e1524f158b1b874c3e244658" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41941 } }
I20260812 06:37:04.401320  2959 raft_consensus.cc:399] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:04.401366  2959 raft_consensus.cc:493] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:04.401449  2959 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:04.402232  2959 raft_consensus.cc:515] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12bd4c0e1524f158b1b874c3e244658" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41941 } }
I20260812 06:37:04.402535  2959 leader_election.cc:304] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d12bd4c0e1524f158b1b874c3e244658; no voters: 
I20260812 06:37:04.402789  2959 leader_election.cc:290] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:04.402901  2964 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:04.403147  2964 raft_consensus.cc:697] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [term 1 LEADER]: Becoming Leader. State: Replica: d12bd4c0e1524f158b1b874c3e244658, State: Running, Role: LEADER
I20260812 06:37:04.403700  2964 consensus_queue.cc:237] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12bd4c0e1524f158b1b874c3e244658" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41941 } }
I20260812 06:37:04.404062  2959 sys_catalog.cc:565] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:04.405290  2965 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d12bd4c0e1524f158b1b874c3e244658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12bd4c0e1524f158b1b874c3e244658" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41941 } } }
I20260812 06:37:04.405504  2966 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d12bd4c0e1524f158b1b874c3e244658. Latest consensus state: current_term: 1 leader_uuid: "d12bd4c0e1524f158b1b874c3e244658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12bd4c0e1524f158b1b874c3e244658" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 41941 } } }
I20260812 06:37:04.405633  2966 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:04.405660  2965 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:04.406287  2973 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:04.409416  2973 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:04.414887  2973 catalog_manager.cc:1383] Generated new cluster ID: 2ad5071a01ad4c4e8d862e128571b9b4
I20260812 06:37:04.414963  2973 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:04.434363  2973 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:04.435338  2973 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:04.440821  2973 catalog_manager.cc:6092] T 00000000000000000000000000000000 P d12bd4c0e1524f158b1b874c3e244658: Generated new TSK 0
I20260812 06:37:04.441515  2973 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:04.455456 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41941
--builtin_ntp_servers=127.28.177.148:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:04.559041  2987 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:04.559255  2987 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:04.559276  2987 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:04.559391  2987 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:04.562753  2987 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:04.562852  2987 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:37:04.566655  2987 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:41941
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.2987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:04.567726  2987 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:04.568921  2987 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:04.571688  2987 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:04.575321  2994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.575342  2996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.575555  2987 server_base.cc:1061] running on GCE node
W20260812 06:37:04.575350  2993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.575968  2987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:04.576545  2987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:04.577735  2987 hybrid_clock.cc:648] HybridClock initialized: now 1786516624577715 us; error 36 us; skew 500 ppm
I20260812 06:37:04.579813  2987 webserver.cc:533] Webserver started at http://127.28.177.129:34363/ using document root <none> and password file <none>
I20260812 06:37:04.580479  2987 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:04.580569  2987 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:04.580806  2987 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:04.582456  2987 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "e83e66ad2be74367869a5a5e96372046"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.582913  2987 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "e83e66ad2be74367869a5a5e96372046"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.586309  2987 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20260812 06:37:04.588449  3002 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.589475  2987 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260812 06:37:04.589591  2987 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "e83e66ad2be74367869a5a5e96372046"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.589668  2987 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:04.599349  2987 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:04.599828  2987 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:04.599961  2987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:04.600548  2987 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:04.601519  2987 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:04.601567  2987 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.601605  2987 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:04.601621  2987 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.610658  2987 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:40153
I20260812 06:37:04.610695  3130 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:40153 every 8 connection(s)
I20260812 06:37:04.611615  2987 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:04.619467  3131 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41941
I20260812 06:37:04.619719  3131 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:04.620275  3131 heartbeater.cc:507] Master 127.28.177.190:41941 requested a full tablet report, sending...
I20260812 06:37:04.621708 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 2987
I20260812 06:37:04.621718  2919 ts_manager.cc:194] Registered new tserver with Master: e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153)
I20260812 06:37:04.621831 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:04.622965  2919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:45079
I20260812 06:37:04.624119 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41941
--builtin_ntp_servers=127.28.177.148:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:04.731498  3134 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:04.731766  3134 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:04.731813  3134 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:04.731895  3134 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:04.735167  3134 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:04.735328  3134 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:37:04.739053  3134 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:41941
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:04.740249  3134 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:04.741377  3134 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:04.744102  3134 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:04.747735  3139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.747741  3140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.747807  3142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.748248  3134 server_base.cc:1061] running on GCE node
I20260812 06:37:04.748553  3134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:04.749128  3134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:04.750305  3134 hybrid_clock.cc:648] HybridClock initialized: now 1786516624750296 us; error 26 us; skew 500 ppm
I20260812 06:37:04.751994  3134 webserver.cc:533] Webserver started at http://127.28.177.130:41447/ using document root <none> and password file <none>
I20260812 06:37:04.752615  3134 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:04.752693  3134 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:04.752885  3134 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:04.754372  3134 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "94fca1080abb426fa8a0d39dcb509d98"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.754887  3134 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "94fca1080abb426fa8a0d39dcb509d98"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.758157  3134 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:04.760432  3149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.761430  3134 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:37:04.761554  3134 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "94fca1080abb426fa8a0d39dcb509d98"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.761651  3134 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:04.775558  3134 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:04.776237  3134 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:04.776404  3134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:04.776961  3134 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:04.777946  3134 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:04.778014  3134 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.778077  3134 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:04.778133  3134 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.787154  3134 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:45787
I20260812 06:37:04.787184  3278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:45787 every 8 connection(s)
I20260812 06:37:04.788054  3134 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:04.790289 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 3134
I20260812 06:37:04.790416 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:04.792661 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41941
--builtin_ntp_servers=127.28.177.148:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:37:04.796533  3279 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41941
I20260812 06:37:04.796804  3279 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:04.797430  3279 heartbeater.cc:507] Master 127.28.177.190:41941 requested a full tablet report, sending...
I20260812 06:37:04.798597  2919 ts_manager.cc:194] Registered new tserver with Master: 94fca1080abb426fa8a0d39dcb509d98 (127.28.177.130:45787)
I20260812 06:37:04.799188  2919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:45873
W20260812 06:37:04.898061  3282 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:04.898325  3282 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:04.898370  3282 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:04.898476  3282 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:04.901777  3282 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:04.901912  3282 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:37:04.905722  3282 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:41941
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:04.906778  3282 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:04.907859  3282 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:04.910758  3282 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:04.914448  3288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.914423  3290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:04.914433  3287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:04.914809  3282 server_base.cc:1061] running on GCE node
I20260812 06:37:04.915189  3282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:04.915728  3282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:04.916906  3282 hybrid_clock.cc:648] HybridClock initialized: now 1786516624916884 us; error 37 us; skew 500 ppm
I20260812 06:37:04.918692  3282 webserver.cc:533] Webserver started at http://127.28.177.131:42587/ using document root <none> and password file <none>
I20260812 06:37:04.919243  3282 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:04.919320  3282 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:04.919538  3282 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:04.921140  3282 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "d9565d101b64491595c69de204e14d5b"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.921633  3282 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "d9565d101b64491595c69de204e14d5b"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.924836  3282 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:04.926764  3296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.927650  3282 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:04.927771  3282 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "d9565d101b64491595c69de204e14d5b"
format_stamp: "Formatted at 2026-08-12 06:37:04 on dist-test-slave-cbbz"
I20260812 06:37:04.927861  3282 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:04.937613  3282 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:04.938182  3282 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:04.938355  3282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:04.938987  3282 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:04.939919  3282 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:04.939987  3282 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.940065  3282 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:04.940124  3282 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:04.949677  3282 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:41035
I20260812 06:37:04.949702  3423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:41035 every 8 connection(s)
I20260812 06:37:04.950559  3282 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:04.958209  3424 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41941
I20260812 06:37:04.958443  3424 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:04.958982  3424 heartbeater.cc:507] Master 127.28.177.190:41941 requested a full tablet report, sending...
I20260812 06:37:04.959260 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 3282
I20260812 06:37:04.959362 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:04.960228  2919 ts_manager.cc:194] Registered new tserver with Master: d9565d101b64491595c69de204e14d5b (127.28.177.131:41035)
I20260812 06:37:04.960817  2919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:45873
I20260812 06:37:04.961546 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.132:0
--local_ip_for_outbound_sockets=127.28.177.132
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:41941
--builtin_ntp_servers=127.28.177.148:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:05.064250  3427 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:05.064507  3427 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:05.064570  3427 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:05.064672  3427 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:05.068017  3427 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:05.068197  3427 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.132
I20260812 06:37:05.071830  3427 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.177.132
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:41941
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:05.072924  3427 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:05.074033  3427 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:05.076805  3427 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:05.080367  3435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.080407  3433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.080382  3432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.080667  3427 server_base.cc:1061] running on GCE node
I20260812 06:37:05.081010  3427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:05.081563  3427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:05.082741  3427 hybrid_clock.cc:648] HybridClock initialized: now 1786516625082727 us; error 33 us; skew 500 ppm
I20260812 06:37:05.084455  3427 webserver.cc:533] Webserver started at http://127.28.177.132:40101/ using document root <none> and password file <none>
I20260812 06:37:05.085011  3427 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:05.085088  3427 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:05.085305  3427 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:05.086787  3427 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/instance:
uuid: "b51021b230074594a9fc5a602c8f023c"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-cbbz"
I20260812 06:37:05.087262  3427 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance:
uuid: "b51021b230074594a9fc5a602c8f023c"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-cbbz"
I20260812 06:37:05.090375  3427 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 06:37:05.092382  3441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.093328  3427 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:37:05.093447  3427 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
uuid: "b51021b230074594a9fc5a602c8f023c"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-cbbz"
I20260812 06:37:05.093537  3427 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:05.107525  3427 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:05.108103  3427 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:05.108296  3427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:05.108817  3427 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:05.109753  3427 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:05.109822  3427 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.109886  3427 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:05.109933  3427 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.119341  3427 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.132:36615
I20260812 06:37:05.119365  3566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.132:36615 every 8 connection(s)
I20260812 06:37:05.120299  3427 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:05.127369 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 3427
I20260812 06:37:05.127504 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance
I20260812 06:37:05.127911  3567 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41941
I20260812 06:37:05.128181  3567 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:05.128729  3567 heartbeater.cc:507] Master 127.28.177.190:41941 requested a full tablet report, sending...
I20260812 06:37:05.129774  2919 ts_manager.cc:194] Registered new tserver with Master: b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615)
I20260812 06:37:05.130300  2919 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.132:40073
I20260812 06:37:05.141551 29382 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:37:05.158605  2919 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53792:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:05.176987  3057 tablet_service.cc:1511] Processing CreateTablet for tablet e3793894ea82477d8d7ac1d59f6d88f5 (DEFAULT_TABLE table=test-workload [id=3fb837f662744b15ba49adf3ab78c0f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:05.176997  3495 tablet_service.cc:1511] Processing CreateTablet for tablet e3793894ea82477d8d7ac1d59f6d88f5 (DEFAULT_TABLE table=test-workload [id=3fb837f662744b15ba49adf3ab78c0f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:05.177258  3205 tablet_service.cc:1511] Processing CreateTablet for tablet e3793894ea82477d8d7ac1d59f6d88f5 (DEFAULT_TABLE table=test-workload [id=3fb837f662744b15ba49adf3ab78c0f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:05.177943  3495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3793894ea82477d8d7ac1d59f6d88f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:05.177959  3205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3793894ea82477d8d7ac1d59f6d88f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:05.177959  3057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3793894ea82477d8d7ac1d59f6d88f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:05.182682  3590 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Bootstrap starting.
I20260812 06:37:05.183887  3593 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98: Bootstrap starting.
I20260812 06:37:05.184440  3592 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046: Bootstrap starting.
I20260812 06:37:05.185108  3590 tablet_bootstrap.cc:654] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:05.185788  3590 log.cc:826] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:05.185942  3593 tablet_bootstrap.cc:654] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:05.186384  3592 tablet_bootstrap.cc:654] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:05.186720  3593 log.cc:826] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:05.187146  3592 log.cc:826] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:05.187407  3590 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: No bootstrap required, opened a new log
I20260812 06:37:05.187613  3590 ts_tablet_manager.cc:1403] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:05.188246  3593 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98: No bootstrap required, opened a new log
I20260812 06:37:05.188434  3593 ts_tablet_manager.cc:1403] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:05.189499  3592 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046: No bootstrap required, opened a new log
I20260812 06:37:05.189661  3592 ts_tablet_manager.cc:1403] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:05.190687  3590 raft_consensus.cc:359] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.190881  3590 raft_consensus.cc:740] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b51021b230074594a9fc5a602c8f023c, State: Initialized, Role: FOLLOWER
I20260812 06:37:05.190855  3593 raft_consensus.cc:359] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.190995  3593 raft_consensus.cc:740] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94fca1080abb426fa8a0d39dcb509d98, State: Initialized, Role: FOLLOWER
I20260812 06:37:05.191233  3593 consensus_queue.cc:260] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.191184  3590 consensus_queue.cc:260] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.191809  3279 heartbeater.cc:499] Master 127.28.177.190:41941 was elected leader, sending a full tablet report...
I20260812 06:37:05.192044  3590 ts_tablet_manager.cc:1434] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 06:37:05.192366  3567 heartbeater.cc:499] Master 127.28.177.190:41941 was elected leader, sending a full tablet report...
I20260812 06:37:05.192687  3592 raft_consensus.cc:359] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.192868  3592 raft_consensus.cc:740] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83e66ad2be74367869a5a5e96372046, State: Initialized, Role: FOLLOWER
I20260812 06:37:05.192984  3593 ts_tablet_manager.cc:1434] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:05.193122  3592 consensus_queue.cc:260] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.193710  3131 heartbeater.cc:499] Master 127.28.177.190:41941 was elected leader, sending a full tablet report...
I20260812 06:37:05.193857  3592 ts_tablet_manager.cc:1434] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:05.221467  3229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3793894ea82477d8d7ac1d59f6d88f5"
dest_uuid: "94fca1080abb426fa8a0d39dcb509d98"
 from {username='slave'} at 127.0.0.1:60718
I20260812 06:37:05.221688  3229 raft_consensus.cc:493] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:37:05.221824  3229 raft_consensus.cc:3060] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:05.222751  3229 raft_consensus.cc:515] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.223780  3229 leader_election.cc:290] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [CANDIDATE]: Term 1 election: Requested vote from peers e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153), b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615)
I20260812 06:37:05.226859 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:37:05.227968  3081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3793894ea82477d8d7ac1d59f6d88f5" candidate_uuid: "94fca1080abb426fa8a0d39dcb509d98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e83e66ad2be74367869a5a5e96372046"
I20260812 06:37:05.228190  3081 raft_consensus.cc:3060] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:05.228227  3515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3793894ea82477d8d7ac1d59f6d88f5" candidate_uuid: "94fca1080abb426fa8a0d39dcb509d98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b51021b230074594a9fc5a602c8f023c"
I20260812 06:37:05.228416  3515 raft_consensus.cc:3060] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:05.229152  3081 raft_consensus.cc:2468] T e3793894ea82477d8d7ac1d59f6d88f5 P e83e66ad2be74367869a5a5e96372046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94fca1080abb426fa8a0d39dcb509d98 in term 1.
I20260812 06:37:05.229238  3515 raft_consensus.cc:2468] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94fca1080abb426fa8a0d39dcb509d98 in term 1.
I20260812 06:37:05.229565  3150 leader_election.cc:304] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94fca1080abb426fa8a0d39dcb509d98, e83e66ad2be74367869a5a5e96372046; no voters: 
I20260812 06:37:05.229849  3597 raft_consensus.cc:2804] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:05.230121  3597 raft_consensus.cc:697] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 1 LEADER]: Becoming Leader. State: Replica: 94fca1080abb426fa8a0d39dcb509d98, State: Running, Role: LEADER
I20260812 06:37:05.230458  3597 consensus_queue.cc:237] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:05.233767  2916 catalog_manager.cc:5719] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94fca1080abb426fa8a0d39dcb509d98 (127.28.177.130). New cstate: current_term: 1 leader_uuid: "94fca1080abb426fa8a0d39dcb509d98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:05.280948  3597 consensus_queue.cc:1048] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:05.286540  3597 consensus_queue.cc:1048] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:05.330366 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 3427
I20260812 06:37:05.341425 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2987
W20260812 06:37:05.366294  3150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111)
W20260812 06:37:05.367180  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:05.369658  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:05.605891  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:37:05.637712  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:37:05.864058  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:37:05.887955  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:37:06.111765  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:37:06.115165  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:37:06.351660  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 06:37:06.383847  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 06:37:06.600618  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 06:37:06.641278  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 06:37:06.835894  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 06:37:06.874058  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 06:37:07.097544  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 06:37:07.103010  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 06:37:07.332850  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 06:37:07.361897  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 06:37:07.557765  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 06:37:07.624487  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 06:37:07.819126  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 06:37:07.841032  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 06:37:08.077457  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 06:37:08.081874  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 06:37:08.321903  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 06:37:08.335630  3615 consensus_queue.cc:579] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Leader has been unable to successfully communicate with peer e83e66ad2be74367869a5a5e96372046 for more than 3 seconds (3.008s)
W20260812 06:37:08.337275  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 06:37:08.370083  3620 consensus_queue.cc:579] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Leader has been unable to successfully communicate with peer b51021b230074594a9fc5a602c8f023c for more than 3 seconds (3.044s)
W20260812 06:37:08.547886  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 06:37:08.585999  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 06:37:08.829628  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 06:37:08.841061  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 06:37:09.054100  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 06:37:09.078290  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 06:37:09.297585  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 06:37:09.323632  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 06:37:09.515184  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 06:37:09.560027  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 06:37:09.745854  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 06:37:09.809746  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 06:37:09.965870  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 06:37:10.081164  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 06:37:10.221212  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 06:37:10.335764  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 06:37:10.385175  3153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111) [suppressed 203 similar messages]
W20260812 06:37:10.476544  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 06:37:10.605736  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 06:37:10.717628  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 06:37:10.875042  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
I20260812 06:37:10.962661  3424 heartbeater.cc:499] Master 127.28.177.190:41941 was elected leader, sending a full tablet report...
W20260812 06:37:10.979856  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 06:37:11.111099  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 06:37:11.228876  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 06:37:11.367493  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 06:37:11.473682  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 06:37:11.651400  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 06:37:11.728462  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 06:37:11.911424  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 06:37:11.981487  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 06:37:12.167450  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 06:37:12.227986  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 06:37:12.441256  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 06:37:12.478816  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 06:37:12.691074  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 06:37:12.704610  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 06:37:12.948827  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 06:37:12.964530  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 06:37:13.177623  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 06:37:13.214968  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 06:37:13.438361  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 06:37:13.438508  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 06:37:13.647565  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 06:37:13.684762  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 06:37:13.894019  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 06:37:13.960950  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 06:37:14.154021  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 06:37:14.181579  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 06:37:14.374651  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 06:37:14.398706  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 06:37:14.620949  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 06:37:14.653717  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 06:37:14.838618  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 06:37:14.897329  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 06:37:15.092214  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 06:37:15.157624  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 06:37:15.344034  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 06:37:15.386762  3150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111) [suppressed 201 similar messages]
W20260812 06:37:15.422439  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 06:37:15.599400  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 06:37:15.680775  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 06:37:15.846597  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 06:37:15.940364  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 06:37:16.097797  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 06:37:16.195827  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 06:37:16.345052  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 06:37:16.433329  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 06:37:16.577409  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 06:37:16.671617  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 06:37:16.817087  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 06:37:16.938637  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
W20260812 06:37:17.050422  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
W20260812 06:37:17.209992  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 241: this message will repeat every 5th retry.
W20260812 06:37:17.286216  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 241: this message will repeat every 5th retry.
I20260812 06:37:17.351310 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.132:36615
--local_ip_for_outbound_sockets=127.28.177.132
--tserver_master_addrs=127.28.177.190:41941
--webserver_port=40101
--webserver_interface=127.28.177.132
--builtin_ntp_servers=127.28.177.148:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:17.459749  3631 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:17.459992  3631 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:17.460041  3631 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:17.460175  3631 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:17.463411  3631 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:17.463555  3631 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.132
I20260812 06:37:17.467342  3631 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.132:36615
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.177.132
--webserver_port=40101
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:41941
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:17.468480  3631 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:17.469570  3631 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:17.472358  3631 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:17.472491  3153 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615): Couldn't send request to peer b51021b230074594a9fc5a602c8f023c. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.132:36615: connect: Connection refused (error 111). This is attempt 246: this message will repeat every 5th retry.
W20260812 06:37:17.475878  3637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:17.475904  3636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:17.476014  3631 server_base.cc:1061] running on GCE node
W20260812 06:37:17.475872  3639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:17.476488  3631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:17.477002  3631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:17.478178  3631 hybrid_clock.cc:648] HybridClock initialized: now 1786516637478164 us; error 29 us; skew 500 ppm
I20260812 06:37:17.479866  3631 webserver.cc:533] Webserver started at http://127.28.177.132:40101/ using document root <none> and password file <none>
I20260812 06:37:17.480487  3631 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:17.480582  3631 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:17.483697  3631 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:17.485611  3645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:17.486495  3631 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:17.486622  3631 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
uuid: "b51021b230074594a9fc5a602c8f023c"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-cbbz"
I20260812 06:37:17.487001  3631 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:17.508119  3631 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:17.508857  3631 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:17.509050  3631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:17.509635  3631 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:17.510880  3653 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:17.514642  3631 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:17.514714  3631 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:17.514781  3631 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:17.516320  3631 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:17.516376  3631 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:17.516814  3653 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Bootstrap starting.
I20260812 06:37:17.527576  3631 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.132:36615
I20260812 06:37:17.527612  3777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.132:36615 every 8 connection(s)
I20260812 06:37:17.528622  3631 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:17.532409  3653 log.cc:826] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:17.535161  3653 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:17.535578  3653 tablet_bootstrap.cc:492] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Bootstrap complete.
I20260812 06:37:17.536974  3653 ts_tablet_manager.cc:1403] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260812 06:37:17.537920 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 3631
I20260812 06:37:17.539928  3653 raft_consensus.cc:359] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:17.540310  3653 raft_consensus.cc:740] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b51021b230074594a9fc5a602c8f023c, State: Initialized, Role: FOLLOWER
I20260812 06:37:17.540629  3653 consensus_queue.cc:260] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } }
I20260812 06:37:17.541548  3653 ts_tablet_manager.cc:1434] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 06:37:17.543481  3778 heartbeater.cc:344] Connected to a master server at 127.28.177.190:41941
I20260812 06:37:17.543751  3778 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:17.544329  3778 heartbeater.cc:507] Master 127.28.177.190:41941 requested a full tablet report, sending...
I20260812 06:37:17.546222  2915 ts_manager.cc:194] Re-registered known tserver with Master: b51021b230074594a9fc5a602c8f023c (127.28.177.132:36615)
I20260812 06:37:17.547283  2915 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.132:46059
W20260812 06:37:17.548123  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 246: this message will repeat every 5th retry.
I20260812 06:37:17.549118  3778 heartbeater.cc:499] Master 127.28.177.190:41941 was elected leader, sending a full tablet report...
I20260812 06:37:17.617483  3229 consensus_queue.cc:237] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } } peers { permanent_uuid: "d9565d101b64491595c69de204e14d5b" member_type: NON_VOTER last_known_addr { host: "127.28.177.131" port: 41035 } attrs { promote: true } }
I20260812 06:37:17.619340  3726 raft_consensus.cc:1275] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 1 FOLLOWER]: Refusing update from remote peer 94fca1080abb426fa8a0d39dcb509d98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:17.619890  3785 consensus_queue.cc:1048] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 06:37:17.620112  3150 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer e83e66ad2be74367869a5a5e96372046 (127.28.177.129:40153): Couldn't send request to peer e83e66ad2be74367869a5a5e96372046. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:40153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:17.622912  3787 raft_consensus.cc:2955] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d9565d101b64491595c69de204e14d5b (127.28.177.131) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } } peers { permanent_uuid: "d9565d101b64491595c69de204e14d5b" member_type: NON_VOTER last_known_addr { host: "127.28.177.131" port: 41035 } attrs { promote: true } } }
W20260812 06:37:17.623538  3151 consensus_peers.cc:597] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 -> Peer d9565d101b64491595c69de204e14d5b (127.28.177.131:41035): Couldn't send request to peer d9565d101b64491595c69de204e14d5b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3793894ea82477d8d7ac1d59f6d88f5. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:17.623574  3726 raft_consensus.cc:2955] T e3793894ea82477d8d7ac1d59f6d88f5 P b51021b230074594a9fc5a602c8f023c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d9565d101b64491595c69de204e14d5b (127.28.177.131) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } } peers { permanent_uuid: "d9565d101b64491595c69de204e14d5b" member_type: NON_VOTER last_known_addr { host: "127.28.177.131" port: 41035 } attrs { promote: true } } }
I20260812 06:37:17.624702  2900 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e3793894ea82477d8d7ac1d59f6d88f5 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 06:37:17.625643  2915 catalog_manager.cc:5719] T e3793894ea82477d8d7ac1d59f6d88f5 P 94fca1080abb426fa8a0d39dcb509d98 reported cstate change: config changed from index -1 to 2, NON_VOTER d9565d101b64491595c69de204e14d5b (127.28.177.131) added. New cstate: current_term: 1 leader_uuid: "94fca1080abb426fa8a0d39dcb509d98" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e83e66ad2be74367869a5a5e96372046" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b51021b230074594a9fc5a602c8f023c" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 36615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94fca1080abb426fa8a0d39dcb509d98" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 45787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9565d101b64491595c69de204e14d5b" member_type: NON_VOTER last_known_addr { host: "127.28.177.131" port: 41035 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:17.675304 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 3134
I20260812 06:37:17.685979 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 3282
I20260812 06:37:17.695055 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 3631
I20260812 06:37:17.703212 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 2882
2026-08-12T06:37:17Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/1 (13504 ms)
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/0
2026-08-12T06:37:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:17Z Disabled control of system clock
I20260812 06:37:17.738339 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:43529
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:43529
--raft_prepare_replacement_before_eviction=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:37:17.844128  3798 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:17.844360  3798 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:17.844444  3798 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:17.847826  3798 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:37:17.847894  3798 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:17.847949  3798 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:17.847997  3798 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:17.848050  3798 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:17.851900  3798 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:43529
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:43529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.3798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:17.853040  3798 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:17.854220  3798 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:17.859763  3805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:17.859761  3808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:17.859916  3803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:17.860774  3798 server_base.cc:1061] running on GCE node
I20260812 06:37:17.861328  3798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:17.862416  3798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:17.863579  3798 hybrid_clock.cc:648] HybridClock initialized: now 1786516637863561 us; error 37 us; skew 500 ppm
I20260812 06:37:17.865267  3798 webserver.cc:533] Webserver started at http://127.28.177.190:46131/ using document root <none> and password file <none>
I20260812 06:37:17.865809  3798 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:17.865890  3798 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:17.866086  3798 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:17.867586  3798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "58e413f4243a49e3b1bf0351f92ebdad"
format_stamp: "Formatted at 2026-08-12 06:37:17 on dist-test-slave-cbbz"
I20260812 06:37:17.868062  3798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "58e413f4243a49e3b1bf0351f92ebdad"
format_stamp: "Formatted at 2026-08-12 06:37:17 on dist-test-slave-cbbz"
I20260812 06:37:17.871186  3798 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:37:17.873298  3814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:17.874243  3798 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:17.874370  3798 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "58e413f4243a49e3b1bf0351f92ebdad"
format_stamp: "Formatted at 2026-08-12 06:37:17 on dist-test-slave-cbbz"
I20260812 06:37:17.874462  3798 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:17.905684  3798 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:17.906468  3798 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:17.906690  3798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:17.913940  3798 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:43529
I20260812 06:37:17.913959  3875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:43529 every 8 connection(s)
I20260812 06:37:17.914937  3798 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:17.917750  3876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:17.922624  3876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad: Bootstrap starting.
I20260812 06:37:17.923720 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 3798
I20260812 06:37:17.923866 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:37:17.925103  3876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:17.925958  3876 log.cc:826] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:17.927663  3876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad: No bootstrap required, opened a new log
I20260812 06:37:17.930303  3876 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e413f4243a49e3b1bf0351f92ebdad" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 43529 } }
I20260812 06:37:17.930518  3876 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:17.930591  3876 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e413f4243a49e3b1bf0351f92ebdad, State: Initialized, Role: FOLLOWER
I20260812 06:37:17.931123  3876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e413f4243a49e3b1bf0351f92ebdad" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 43529 } }
I20260812 06:37:17.931277  3876 raft_consensus.cc:399] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:17.931362  3876 raft_consensus.cc:493] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:17.931480  3876 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:17.932452  3876 raft_consensus.cc:515] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e413f4243a49e3b1bf0351f92ebdad" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 43529 } }
I20260812 06:37:17.932786  3876 leader_election.cc:304] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58e413f4243a49e3b1bf0351f92ebdad; no voters: 
I20260812 06:37:17.933145  3876 leader_election.cc:290] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:17.933243  3881 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:17.933475  3881 raft_consensus.cc:697] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [term 1 LEADER]: Becoming Leader. State: Replica: 58e413f4243a49e3b1bf0351f92ebdad, State: Running, Role: LEADER
I20260812 06:37:17.933751  3881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e413f4243a49e3b1bf0351f92ebdad" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 43529 } }
I20260812 06:37:17.934242  3876 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:17.935308  3882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58e413f4243a49e3b1bf0351f92ebdad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e413f4243a49e3b1bf0351f92ebdad" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 43529 } } }
I20260812 06:37:17.935432  3882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:17.935818  3892 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:17.935909  3883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58e413f4243a49e3b1bf0351f92ebdad. Latest consensus state: current_term: 1 leader_uuid: "58e413f4243a49e3b1bf0351f92ebdad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58e413f4243a49e3b1bf0351f92ebdad" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 43529 } } }
I20260812 06:37:17.936002  3883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:17.938380  3892 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:17.943320  3892 catalog_manager.cc:1383] Generated new cluster ID: 41a4957aab88452887d4e55631ffd44a
I20260812 06:37:17.943387  3892 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:17.955346  3892 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:17.956275  3892 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:17.966619  3892 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 58e413f4243a49e3b1bf0351f92ebdad: Generated new TSK 0
I20260812 06:37:17.967252  3892 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:17.971248 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:43529
--builtin_ntp_servers=127.28.177.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:18.074791  3905 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:18.074999  3905 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.075019  3905 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.075104  3905 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.078554  3905 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:37:18.078613  3905 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.078737  3905 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:37:18.082666  3905 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:43529
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.083752  3905 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.084935  3905 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:18.087607  3905 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:18.091228  3912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.091253  3911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.091373  3914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.091682  3905 server_base.cc:1061] running on GCE node
I20260812 06:37:18.092038  3905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:18.092648  3905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:18.093819  3905 hybrid_clock.cc:648] HybridClock initialized: now 1786516638093804 us; error 35 us; skew 500 ppm
I20260812 06:37:18.095698  3905 webserver.cc:533] Webserver started at http://127.28.177.129:40665/ using document root <none> and password file <none>
I20260812 06:37:18.096364  3905 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:18.096428  3905 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:18.096647  3905 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:18.098519  3905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "9de85e0dac23426d8f286fafe5ffc3a5"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.099046  3905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "9de85e0dac23426d8f286fafe5ffc3a5"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.102975  3905 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:18.105423  3920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.106384  3905 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:18.106523  3905 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "9de85e0dac23426d8f286fafe5ffc3a5"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.106631  3905 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:18.129462  3905 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:18.130141  3905 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:18.130321  3905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:18.130877  3905 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:18.131844  3905 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:18.131917  3905 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.131991  3905 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:18.132033  3905 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.141402  3905 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:33093
I20260812 06:37:18.141441  4046 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:33093 every 8 connection(s)
I20260812 06:37:18.142349  3905 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:18.147543 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 3905
I20260812 06:37:18.147666 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:18.150261 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:43529
--builtin_ntp_servers=127.28.177.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:37:18.152778  4047 heartbeater.cc:344] Connected to a master server at 127.28.177.190:43529
I20260812 06:37:18.153026  4047 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:18.153551  4047 heartbeater.cc:507] Master 127.28.177.190:43529 requested a full tablet report, sending...
I20260812 06:37:18.155048  3834 ts_manager.cc:194] Registered new tserver with Master: 9de85e0dac23426d8f286fafe5ffc3a5 (127.28.177.129:33093)
I20260812 06:37:18.156280  3834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:36649
W20260812 06:37:18.257062  4050 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:18.257385  4050 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.257436  4050 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.257530  4050 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.262416  4050 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:37:18.262513  4050 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.262655  4050 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:37:18.268427  4050 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:43529
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.269888  4050 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.271371  4050 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:18.275246  4050 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:18.280028  4056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.280393  4055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.280500  4050 server_base.cc:1061] running on GCE node
W20260812 06:37:18.281481  4058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.281996  4050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:18.282707  4050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:18.283893  4050 hybrid_clock.cc:648] HybridClock initialized: now 1786516638283836 us; error 85 us; skew 500 ppm
I20260812 06:37:18.286163  4050 webserver.cc:533] Webserver started at http://127.28.177.130:41205/ using document root <none> and password file <none>
I20260812 06:37:18.286999  4050 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:18.287089  4050 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:18.287343  4050 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:18.289669  4050 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "9bbcce836d4c44cbba6449edb3c44726"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.290341  4050 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "9bbcce836d4c44cbba6449edb3c44726"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.295257  4050 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260812 06:37:18.298486  4065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.299772  4050 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260812 06:37:18.299906  4050 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "9bbcce836d4c44cbba6449edb3c44726"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.300025  4050 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:18.320230  4050 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:18.320854  4050 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:18.320998  4050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:18.321488  4050 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:18.322444  4050 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:18.322492  4050 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.322532  4050 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:18.322547  4050 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.331625  4050 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:35035
I20260812 06:37:18.331701  4190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:35035 every 8 connection(s)
I20260812 06:37:18.332638  4050 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:18.339203 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4050
I20260812 06:37:18.339342 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:18.341949  4191 heartbeater.cc:344] Connected to a master server at 127.28.177.190:43529
I20260812 06:37:18.342001 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:43529
--builtin_ntp_servers=127.28.177.148:46599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:37:18.342247  4191 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:18.342682  4191 heartbeater.cc:507] Master 127.28.177.190:43529 requested a full tablet report, sending...
I20260812 06:37:18.343752  3834 ts_manager.cc:194] Registered new tserver with Master: 9bbcce836d4c44cbba6449edb3c44726 (127.28.177.130:35035)
I20260812 06:37:18.344538  3834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:60371
W20260812 06:37:18.444937  4194 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:18.445143  4194 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.445168  4194 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.445211  4194 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.448596  4194 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 06:37:18.448661  4194 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.448730  4194 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:37:18.452458  4194 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:46599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:43529
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.453451  4194 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.454526  4194 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:18.457109  4194 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:18.460601  4200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.460664  4201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.460606  4203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.461182  4194 server_base.cc:1061] running on GCE node
I20260812 06:37:18.461551  4194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:18.462081  4194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:18.463240  4194 hybrid_clock.cc:648] HybridClock initialized: now 1786516638463215 us; error 38 us; skew 500 ppm
I20260812 06:37:18.464919  4194 webserver.cc:533] Webserver started at http://127.28.177.131:33475/ using document root <none> and password file <none>
I20260812 06:37:18.465461  4194 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:18.465514  4194 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:18.465716  4194 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:18.467224  4194 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "e3bce266989a4992bbfa320f01caeb5f"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.467682  4194 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "e3bce266989a4992bbfa320f01caeb5f"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.470818  4194 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260812 06:37:18.472889  4209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.473826  4194 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:18.473940  4194 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "e3bce266989a4992bbfa320f01caeb5f"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-cbbz"
I20260812 06:37:18.474030  4194 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:18.489923  4194 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:18.490523  4194 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:18.490716  4194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:18.491250  4194 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:18.492215  4194 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:18.492265  4194 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.492304  4194 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:18.492324  4194 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.501272  4194 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:44187
I20260812 06:37:18.501331  4336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:44187 every 8 connection(s)
I20260812 06:37:18.502184  4194 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:18.508266 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4194
I20260812 06:37:18.508417 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:18.510607  4337 heartbeater.cc:344] Connected to a master server at 127.28.177.190:43529
I20260812 06:37:18.510831  4337 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:18.511186  4337 heartbeater.cc:507] Master 127.28.177.190:43529 requested a full tablet report, sending...
I20260812 06:37:18.512081  3834 ts_manager.cc:194] Registered new tserver with Master: e3bce266989a4992bbfa320f01caeb5f (127.28.177.131:44187)
I20260812 06:37:18.512662  3834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:35841
I20260812 06:37:18.522439 29382 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:18.538810  3834 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33088:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:18.556358  3972 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef45b7cad2d4a3799451e30a250d76f (DEFAULT_TABLE table=test-workload [id=a39c133ca47446f9acfc6730bd3e68e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:18.556722  4119 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef45b7cad2d4a3799451e30a250d76f (DEFAULT_TABLE table=test-workload [id=a39c133ca47446f9acfc6730bd3e68e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:18.557029  4261 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef45b7cad2d4a3799451e30a250d76f (DEFAULT_TABLE table=test-workload [id=a39c133ca47446f9acfc6730bd3e68e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:18.557351  3972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef45b7cad2d4a3799451e30a250d76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:18.557643  4119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef45b7cad2d4a3799451e30a250d76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:18.557839  4261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef45b7cad2d4a3799451e30a250d76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:18.562332  4361 tablet_bootstrap.cc:492] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: Bootstrap starting.
I20260812 06:37:18.563627  4362 tablet_bootstrap.cc:492] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Bootstrap starting.
I20260812 06:37:18.563661  4363 tablet_bootstrap.cc:492] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f: Bootstrap starting.
I20260812 06:37:18.564944  4361 tablet_bootstrap.cc:654] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:18.565411  4363 tablet_bootstrap.cc:654] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:18.565663  4362 tablet_bootstrap.cc:654] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:18.565811  4361 log.cc:826] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:18.566159  4363 log.cc:826] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:18.566450  4362 log.cc:826] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:18.567677  4361 tablet_bootstrap.cc:492] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: No bootstrap required, opened a new log
I20260812 06:37:18.567871  4361 ts_tablet_manager.cc:1403] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 06:37:18.568030  4362 tablet_bootstrap.cc:492] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: No bootstrap required, opened a new log
I20260812 06:37:18.568248  4362 ts_tablet_manager.cc:1403] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:37:18.568938  4363 tablet_bootstrap.cc:492] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f: No bootstrap required, opened a new log
I20260812 06:37:18.569151  4363 ts_tablet_manager.cc:1403] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
I20260812 06:37:18.571022  4362 raft_consensus.cc:359] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.571015  4361 raft_consensus.cc:359] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.571234  4362 raft_consensus.cc:740] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bbcce836d4c44cbba6449edb3c44726, State: Initialized, Role: FOLLOWER
I20260812 06:37:18.571234  4361 raft_consensus.cc:740] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de85e0dac23426d8f286fafe5ffc3a5, State: Initialized, Role: FOLLOWER
I20260812 06:37:18.571565  4362 consensus_queue.cc:260] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.571585  4361 consensus_queue.cc:260] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.571975  4363 raft_consensus.cc:359] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.572188  4363 raft_consensus.cc:740] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bce266989a4992bbfa320f01caeb5f, State: Initialized, Role: FOLLOWER
I20260812 06:37:18.572479  4361 ts_tablet_manager.cc:1434] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:18.572503  4363 consensus_queue.cc:260] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.572613  4047 heartbeater.cc:499] Master 127.28.177.190:43529 was elected leader, sending a full tablet report...
I20260812 06:37:18.573167  4337 heartbeater.cc:499] Master 127.28.177.190:43529 was elected leader, sending a full tablet report...
I20260812 06:37:18.573305  4363 ts_tablet_manager.cc:1434] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260812 06:37:18.572479  4362 ts_tablet_manager.cc:1434] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:18.572670  4191 heartbeater.cc:499] Master 127.28.177.190:43529 was elected leader, sending a full tablet report...
W20260812 06:37:18.583468  4192 tablet.cc:2406] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:18.603559  4142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ef45b7cad2d4a3799451e30a250d76f"
dest_uuid: "9bbcce836d4c44cbba6449edb3c44726"
 from {username='slave'} at 127.0.0.1:36604
I20260812 06:37:18.603798  4142 raft_consensus.cc:493] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:37:18.603932  4142 raft_consensus.cc:3060] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:18.604948  4142 raft_consensus.cc:515] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.605923  4142 leader_election.cc:290] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [CANDIDATE]: Term 1 election: Requested vote from peers e3bce266989a4992bbfa320f01caeb5f (127.28.177.131:44187), 9de85e0dac23426d8f286fafe5ffc3a5 (127.28.177.129:33093)
I20260812 06:37:18.609181 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:37:18.609653  4284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef45b7cad2d4a3799451e30a250d76f" candidate_uuid: "9bbcce836d4c44cbba6449edb3c44726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e3bce266989a4992bbfa320f01caeb5f"
I20260812 06:37:18.609855  4284 raft_consensus.cc:3060] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:18.610509  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef45b7cad2d4a3799451e30a250d76f" candidate_uuid: "9bbcce836d4c44cbba6449edb3c44726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9de85e0dac23426d8f286fafe5ffc3a5"
I20260812 06:37:18.610709  3995 raft_consensus.cc:3060] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:18.610961  4284 raft_consensus.cc:2468] T 1ef45b7cad2d4a3799451e30a250d76f P e3bce266989a4992bbfa320f01caeb5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbcce836d4c44cbba6449edb3c44726 in term 1.
I20260812 06:37:18.611382  4066 leader_election.cc:304] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bbcce836d4c44cbba6449edb3c44726, e3bce266989a4992bbfa320f01caeb5f; no voters: 
I20260812 06:37:18.611666  4367 raft_consensus.cc:2804] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:18.611900  4367 raft_consensus.cc:697] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 1 LEADER]: Becoming Leader. State: Replica: 9bbcce836d4c44cbba6449edb3c44726, State: Running, Role: LEADER
I20260812 06:37:18.611884  3995 raft_consensus.cc:2468] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bbcce836d4c44cbba6449edb3c44726 in term 1.
I20260812 06:37:18.612313  4367 consensus_queue.cc:237] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:18.615407  3833 catalog_manager.cc:5719] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bbcce836d4c44cbba6449edb3c44726 (127.28.177.130). New cstate: current_term: 1 leader_uuid: "9bbcce836d4c44cbba6449edb3c44726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } }
W20260812 06:37:18.643553  4048 tablet.cc:2406] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:18.658481  4367 consensus_queue.cc:1048] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:18.659044  4367 consensus_queue.cc:1048] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:37:20.726022  4066 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.28.177.129:33093 timed out after 2.000s (SENT)
W20260812 06:37:22.727643  4066 consensus_peers.cc:597] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 -> Peer 9de85e0dac23426d8f286fafe5ffc3a5 (127.28.177.129:33093): Couldn't send request to peer 9de85e0dac23426d8f286fafe5ffc3a5. Status: Timed out: UpdateConsensus RPC to 127.28.177.129:33093 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:22.775835  4066 consensus_peers.cc:597] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 -> Peer e3bce266989a4992bbfa320f01caeb5f (127.28.177.131:44187): Couldn't send request to peer e3bce266989a4992bbfa320f01caeb5f. Status: Timed out: UpdateConsensus RPC to 127.28.177.131:44187 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:28.768069  4066 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.28.177.129:33093 timed out after 2.000s (SENT) [suppressed 3 similar messages]
I20260812 06:37:30.813781  4386 raft_consensus.cc:1012] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726: Attempting to remove follower e3bce266989a4992bbfa320f01caeb5f from the Raft config. Reason: Leader has been unable to successfully communicate with peer e3bce266989a4992bbfa320f01caeb5f for more than 3 seconds (12.099s)
I20260812 06:37:30.814822  4386 consensus_queue.cc:237] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } }
I20260812 06:37:30.816358  3990 raft_consensus.cc:1275] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 1 FOLLOWER]: Refusing update from remote peer 9bbcce836d4c44cbba6449edb3c44726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:30.816906  4388 consensus_queue.cc:1048] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:37:30.819125  4386 raft_consensus.cc:2955] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER e3bce266989a4992bbfa320f01caeb5f (127.28.177.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } }
I20260812 06:37:30.819586  3990 raft_consensus.cc:2955] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER e3bce266989a4992bbfa320f01caeb5f (127.28.177.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } }
I20260812 06:37:30.822405  3833 catalog_manager.cc:5719] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 reported cstate change: config changed from index -1 to 2, VOTER e3bce266989a4992bbfa320f01caeb5f (127.28.177.131) evicted. New cstate: current_term: 1 leader_uuid: "9bbcce836d4c44cbba6449edb3c44726" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } }
I20260812 06:37:30.826721  4142 consensus_queue.cc:237] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } }
I20260812 06:37:30.828040  3990 raft_consensus.cc:1275] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 1 FOLLOWER]: Refusing update from remote peer 9bbcce836d4c44cbba6449edb3c44726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:37:30.828473  4388 consensus_queue.cc:1048] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:37:30.830240  4386 raft_consensus.cc:2955] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER e3bce266989a4992bbfa320f01caeb5f (127.28.177.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } }
I20260812 06:37:30.830859  3990 raft_consensus.cc:2955] T 1ef45b7cad2d4a3799451e30a250d76f P 9de85e0dac23426d8f286fafe5ffc3a5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER e3bce266989a4992bbfa320f01caeb5f (127.28.177.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } }
I20260812 06:37:30.831804  3818 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 1ef45b7cad2d4a3799451e30a250d76f with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260812 06:37:30.832544  3833 catalog_manager.cc:5719] T 1ef45b7cad2d4a3799451e30a250d76f P 9bbcce836d4c44cbba6449edb3c44726 reported cstate change: config changed from index 2 to 3, VOTER e3bce266989a4992bbfa320f01caeb5f (127.28.177.131) added. New cstate: current_term: 1 leader_uuid: "9bbcce836d4c44cbba6449edb3c44726" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9de85e0dac23426d8f286fafe5ffc3a5" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 33093 } } peers { permanent_uuid: "9bbcce836d4c44cbba6449edb3c44726" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 35035 } } peers { permanent_uuid: "e3bce266989a4992bbfa320f01caeb5f" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 44187 } } }
W20260812 06:37:30.868579  4069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:30.875969 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 3905
W20260812 06:37:30.887662  4066 connection.cc:573] client connection to 127.28.177.129:33093 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:30.888315 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4050
I20260812 06:37:30.896855 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4194
W20260812 06:37:30.904945  3815 connection.cc:573] client connection to 127.28.177.131:44187 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:30.905131  3815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:30.905216 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 3798
2026-08-12T06:37:30Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/0 (13202 ms)
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/1
2026-08-12T06:37:30Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:30Z Disabled control of system clock
I20260812 06:37:30.938495 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:45679
--webserver_interface=127.28.177.190
--webserver_port=0
--builtin_ntp_servers=127.28.177.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.177.190:45679
--raft_prepare_replacement_before_eviction=true
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:37:31.042459  4402 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:31.042652  4402 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:31.042691  4402 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:31.045912  4402 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:31.045962  4402 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:31.045982  4402 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:31.046000  4402 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:31.049657  4402 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.177.190:45679
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.177.190:45679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.177.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.4402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:31.050709  4402 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:31.051769  4402 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:31.057241  4410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.057211  4413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.057221  4411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:31.057520  4402 server_base.cc:1061] running on GCE node
I20260812 06:37:31.058013  4402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:31.058825  4402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:31.060011  4402 hybrid_clock.cc:648] HybridClock initialized: now 1786516651059998 us; error 33 us; skew 500 ppm
I20260812 06:37:31.061731  4402 webserver.cc:533] Webserver started at http://127.28.177.190:37913/ using document root <none> and password file <none>
I20260812 06:37:31.062309  4402 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:31.062394  4402 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:31.062613  4402 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:31.064507  4402 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data/instance:
uuid: "3f0e076b4c3d45e3b790db609f608cbf"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.064965  4402 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal/instance:
uuid: "3f0e076b4c3d45e3b790db609f608cbf"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.068212  4402 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:31.070199  4420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.071138  4402 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:31.071280  4402 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal
uuid: "3f0e076b4c3d45e3b790db609f608cbf"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.071376  4402 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:31.105423  4402 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:31.106145  4402 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:31.106352  4402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:31.113865  4480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.190:45679 every 8 connection(s)
I20260812 06:37:31.113870  4402 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.190:45679
I20260812 06:37:31.114857  4402 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:31.117700  4481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:31.122856  4481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf: Bootstrap starting.
I20260812 06:37:31.123543 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4402
I20260812 06:37:31.123677 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/master-0/wal/instance
I20260812 06:37:31.125671  4481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:31.126379  4481 log.cc:826] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:31.128101  4481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf: No bootstrap required, opened a new log
I20260812 06:37:31.131222  4481 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0e076b4c3d45e3b790db609f608cbf" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 45679 } }
I20260812 06:37:31.131435  4481 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:31.131515  4481 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0e076b4c3d45e3b790db609f608cbf, State: Initialized, Role: FOLLOWER
I20260812 06:37:31.131912  4481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0e076b4c3d45e3b790db609f608cbf" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 45679 } }
I20260812 06:37:31.132042  4481 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:31.132141  4481 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:31.132311  4481 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:31.133203  4481 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0e076b4c3d45e3b790db609f608cbf" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 45679 } }
I20260812 06:37:31.133533  4481 leader_election.cc:304] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f0e076b4c3d45e3b790db609f608cbf; no voters: 
I20260812 06:37:31.133809  4481 leader_election.cc:290] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:31.133937  4486 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:31.134181  4486 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0e076b4c3d45e3b790db609f608cbf, State: Running, Role: LEADER
I20260812 06:37:31.134485  4486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0e076b4c3d45e3b790db609f608cbf" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 45679 } }
I20260812 06:37:31.134851  4481 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:31.136111  4487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f0e076b4c3d45e3b790db609f608cbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0e076b4c3d45e3b790db609f608cbf" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 45679 } } }
I20260812 06:37:31.136152  4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f0e076b4c3d45e3b790db609f608cbf. Latest consensus state: current_term: 1 leader_uuid: "3f0e076b4c3d45e3b790db609f608cbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f0e076b4c3d45e3b790db609f608cbf" member_type: VOTER last_known_addr { host: "127.28.177.190" port: 45679 } } }
I20260812 06:37:31.136361  4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:31.136611  4487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:31.136991  4498 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:31.139776  4498 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:31.145300  4498 catalog_manager.cc:1383] Generated new cluster ID: e4fec5d6233f4fe3bf8346a868152f43
I20260812 06:37:31.145375  4498 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:31.153236  4498 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:31.153991  4498 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:31.163339  4498 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 3f0e076b4c3d45e3b790db609f608cbf: Generated new TSK 0
I20260812 06:37:31.163910  4498 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:31.174182 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.129:0
--local_ip_for_outbound_sockets=127.28.177.129
--webserver_interface=127.28.177.129
--webserver_port=0
--tserver_master_addrs=127.28.177.190:45679
--builtin_ntp_servers=127.28.177.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 06:37:31.276602  4508 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:31.276845  4508 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:31.276911  4508 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:31.277014  4508 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:31.280403  4508 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:31.280557  4508 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.129
I20260812 06:37:31.284264  4508 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.177.129
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:45679
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:31.285279  4508 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:31.286361  4508 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:31.289047  4508 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:31.292562  4516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.292575  4515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.292901  4518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:31.293186  4508 server_base.cc:1061] running on GCE node
I20260812 06:37:31.293550  4508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:31.294114  4508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:31.295293  4508 hybrid_clock.cc:648] HybridClock initialized: now 1786516651295275 us; error 34 us; skew 500 ppm
I20260812 06:37:31.297297  4508 webserver.cc:533] Webserver started at http://127.28.177.129:42065/ using document root <none> and password file <none>
I20260812 06:37:31.298070  4508 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:31.298148  4508 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:31.298342  4508 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:31.300272  4508 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data/instance:
uuid: "a907b61c31254a2a809637c29c5d6f95"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.300796  4508 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance:
uuid: "a907b61c31254a2a809637c29c5d6f95"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.304790  4508 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 06:37:31.307380  4524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.308475  4508 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:31.308597  4508 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
uuid: "a907b61c31254a2a809637c29c5d6f95"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.308698  4508 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:31.332363  4508 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:31.333017  4508 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:31.333174  4508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:31.333704  4508 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:31.334658  4508 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:31.334707  4508 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.334748  4508 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:31.334762  4508 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.344223  4508 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.129:34645
I20260812 06:37:31.344251  4660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.129:34645 every 8 connection(s)
I20260812 06:37:31.345108  4508 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:31.350903 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4508
I20260812 06:37:31.351065 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:31.353142  4661 heartbeater.cc:344] Connected to a master server at 127.28.177.190:45679
I20260812 06:37:31.353391  4661 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:31.353407 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.130:0
--local_ip_for_outbound_sockets=127.28.177.130
--webserver_interface=127.28.177.130
--webserver_port=0
--tserver_master_addrs=127.28.177.190:45679
--builtin_ntp_servers=127.28.177.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:37:31.353943  4661 heartbeater.cc:507] Master 127.28.177.190:45679 requested a full tablet report, sending...
I20260812 06:37:31.355388  4440 ts_manager.cc:194] Registered new tserver with Master: a907b61c31254a2a809637c29c5d6f95 (127.28.177.129:34645)
I20260812 06:37:31.356564  4440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.129:37107
W20260812 06:37:31.456420  4664 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:31.456666  4664 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:31.456735  4664 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:31.456817  4664 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:31.460176  4664 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:31.460336  4664 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.130
I20260812 06:37:31.464006  4664 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.177.130
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:45679
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:31.465018  4664 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:31.466089  4664 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:31.468777  4664 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:31.472399  4670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.472496  4672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.472462  4669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:31.472625  4664 server_base.cc:1061] running on GCE node
I20260812 06:37:31.473037  4664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:31.473544  4664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:31.474721  4664 hybrid_clock.cc:648] HybridClock initialized: now 1786516651474706 us; error 31 us; skew 500 ppm
I20260812 06:37:31.476439  4664 webserver.cc:533] Webserver started at http://127.28.177.130:39583/ using document root <none> and password file <none>
I20260812 06:37:31.476964  4664 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:31.477056  4664 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:31.477272  4664 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:31.478894  4664 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data/instance:
uuid: "8223c8402fc14e658b387db94ca2e99a"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.479384  4664 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance:
uuid: "8223c8402fc14e658b387db94ca2e99a"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.482564  4664 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:31.484694  4680 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.485555  4664 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:31.485685  4664 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
uuid: "8223c8402fc14e658b387db94ca2e99a"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.485781  4664 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:31.499714  4664 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:31.500332  4664 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:31.500523  4664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:31.501040  4664 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:31.501971  4664 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:31.502050  4664 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.502120  4664 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:31.502169  4664 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.511348  4664 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.130:38043
I20260812 06:37:31.511391  4810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.130:38043 every 8 connection(s)
I20260812 06:37:31.512251  4664 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:31.519565 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4664
I20260812 06:37:31.519716 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:31.520460  4811 heartbeater.cc:344] Connected to a master server at 127.28.177.190:45679
I20260812 06:37:31.520727  4811 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:31.521260  4811 heartbeater.cc:507] Master 127.28.177.190:45679 requested a full tablet report, sending...
I20260812 06:37:31.522125 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.131:0
--local_ip_for_outbound_sockets=127.28.177.131
--webserver_interface=127.28.177.131
--webserver_port=0
--tserver_master_addrs=127.28.177.190:45679
--builtin_ntp_servers=127.28.177.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:37:31.522385  4440 ts_manager.cc:194] Registered new tserver with Master: 8223c8402fc14e658b387db94ca2e99a (127.28.177.130:38043)
I20260812 06:37:31.522943  4440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.130:41261
W20260812 06:37:31.627588  4814 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:31.627784  4814 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:31.627807  4814 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:31.627851  4814 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:31.631295  4814 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:31.631394  4814 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.131
I20260812 06:37:31.635028  4814 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.177.131
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:45679
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:31.635942  4814 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:31.637177  4814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:31.639817  4814 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:31.643340  4822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.643340  4820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.643335  4819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:31.643424  4814 server_base.cc:1061] running on GCE node
I20260812 06:37:31.643985  4814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:31.644577  4814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:31.645777  4814 hybrid_clock.cc:648] HybridClock initialized: now 1786516651645760 us; error 33 us; skew 500 ppm
I20260812 06:37:31.647466  4814 webserver.cc:533] Webserver started at http://127.28.177.131:36335/ using document root <none> and password file <none>
I20260812 06:37:31.648012  4814 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:31.648092  4814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:31.648320  4814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:31.649796  4814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data/instance:
uuid: "0a54c79a655c49db82a0f879c5022fe7"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.650288  4814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance:
uuid: "0a54c79a655c49db82a0f879c5022fe7"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.653422  4814 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260812 06:37:31.655391  4829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.656311  4814 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:31.656431  4814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
uuid: "0a54c79a655c49db82a0f879c5022fe7"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.656539  4814 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:31.671206  4814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:31.671783  4814 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:31.671964  4814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:31.672565  4814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:31.673524  4814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:31.673573  4814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.673610  4814 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:31.673658  4814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.683373  4814 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.131:37293
I20260812 06:37:31.683398  4957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.131:37293 every 8 connection(s)
I20260812 06:37:31.684350  4814 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:31.688390 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4814
I20260812 06:37:31.688520 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:31.690846 29382 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
/tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.177.132:0
--local_ip_for_outbound_sockets=127.28.177.132
--webserver_interface=127.28.177.132
--webserver_port=0
--tserver_master_addrs=127.28.177.190:45679
--builtin_ntp_servers=127.28.177.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 06:37:31.693066  4958 heartbeater.cc:344] Connected to a master server at 127.28.177.190:45679
I20260812 06:37:31.693334  4958 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:31.693805  4958 heartbeater.cc:507] Master 127.28.177.190:45679 requested a full tablet report, sending...
I20260812 06:37:31.694736  4440 ts_manager.cc:194] Registered new tserver with Master: 0a54c79a655c49db82a0f879c5022fe7 (127.28.177.131:37293)
I20260812 06:37:31.695289  4440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.131:39303
W20260812 06:37:31.796254  4963 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:31.796496  4963 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:31.796563  4963 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:31.796665  4963 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:31.799904  4963 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:31.800067  4963 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.177.132
I20260812 06:37:31.803750  4963 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.177.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.177.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.177.132
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.28.177.190:45679
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.177.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:31.804828  4963 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:31.805891  4963 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:31.808594  4963 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:31.812086  4969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.812121  4971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:31.812144  4968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:31.812472  4963 server_base.cc:1061] running on GCE node
I20260812 06:37:31.812788  4963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:31.813382  4963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:31.814559  4963 hybrid_clock.cc:648] HybridClock initialized: now 1786516651814547 us; error 26 us; skew 500 ppm
I20260812 06:37:31.816246  4963 webserver.cc:533] Webserver started at http://127.28.177.132:34705/ using document root <none> and password file <none>
I20260812 06:37:31.816795  4963 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:31.816876  4963 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:31.817071  4963 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:31.818485  4963 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data/instance:
uuid: "ff05b0a45522423c8fb3673d1704c6da"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.818945  4963 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance:
uuid: "ff05b0a45522423c8fb3673d1704c6da"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.822007  4963 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:31.823897  4978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.824851  4963 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:31.824975  4963 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data,/tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
uuid: "ff05b0a45522423c8fb3673d1704c6da"
format_stamp: "Formatted at 2026-08-12 06:37:31 on dist-test-slave-cbbz"
I20260812 06:37:31.825066  4963 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:31.834091  4963 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:31.834611  4963 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:31.834795  4963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:31.835281  4963 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:31.836303  4963 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:31.836371  4963 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.836429  4963 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:31.836479  4963 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:31.845732  4963 rpc_server.cc:307] RPC server started. Bound to: 127.28.177.132:46007
I20260812 06:37:31.845765  5107 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.177.132:46007 every 8 connection(s)
I20260812 06:37:31.846683  4963 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:31.847925 29382 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu as pid 4963
I20260812 06:37:31.848048 29382 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskfQ8YU0/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786516569449997-29382-0/minicluster-data/ts-3/wal/instance
I20260812 06:37:31.854677  5108 heartbeater.cc:344] Connected to a master server at 127.28.177.190:45679
I20260812 06:37:31.854928  5108 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:31.855412  5108 heartbeater.cc:507] Master 127.28.177.190:45679 requested a full tablet report, sending...
I20260812 06:37:31.856402  4440 ts_manager.cc:194] Registered new tserver with Master: ff05b0a45522423c8fb3673d1704c6da (127.28.177.132:46007)
I20260812 06:37:31.856935  4440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.177.132:58373
I20260812 06:37:31.862226 29382 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:37:31.878329  4440 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59078:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:31.896214  4583 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdc795a39f64cf7919a0fd9eb32b227 (DEFAULT_TABLE table=test-workload [id=325f9fa252534362894adf21d6bf81b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:31.896200  5030 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdc795a39f64cf7919a0fd9eb32b227 (DEFAULT_TABLE table=test-workload [id=325f9fa252534362894adf21d6bf81b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:31.896200  4881 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdc795a39f64cf7919a0fd9eb32b227 (DEFAULT_TABLE table=test-workload [id=325f9fa252534362894adf21d6bf81b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:31.897079  4583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc795a39f64cf7919a0fd9eb32b227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:31.897109  4881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc795a39f64cf7919a0fd9eb32b227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:31.897109  5030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc795a39f64cf7919a0fd9eb32b227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:31.901913  5133 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95: Bootstrap starting.
I20260812 06:37:31.903077  5134 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Bootstrap starting.
I20260812 06:37:31.903142  5135 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da: Bootstrap starting.
I20260812 06:37:31.904533  5133 tablet_bootstrap.cc:654] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:31.905062  5135 tablet_bootstrap.cc:654] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:31.905205  5134 tablet_bootstrap.cc:654] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:31.905380  5133 log.cc:826] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:31.905864  5135 log.cc:826] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:31.906008  5134 log.cc:826] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:31.907263  5133 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95: No bootstrap required, opened a new log
I20260812 06:37:31.907452  5133 ts_tablet_manager.cc:1403] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:37:31.907584  5135 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da: No bootstrap required, opened a new log
I20260812 06:37:31.907608  5134 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: No bootstrap required, opened a new log
I20260812 06:37:31.907771  5135 ts_tablet_manager.cc:1403] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:31.907792  5134 ts_tablet_manager.cc:1403] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:31.910506  5135 raft_consensus.cc:359] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.910494  5133 raft_consensus.cc:359] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.910694  5133 raft_consensus.cc:740] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a907b61c31254a2a809637c29c5d6f95, State: Initialized, Role: FOLLOWER
I20260812 06:37:31.910737  5135 raft_consensus.cc:740] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff05b0a45522423c8fb3673d1704c6da, State: Initialized, Role: FOLLOWER
I20260812 06:37:31.911026  5133 consensus_queue.cc:260] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.911026  5135 consensus_queue.cc:260] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.911509  5134 raft_consensus.cc:359] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.911755  5134 raft_consensus.cc:740] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a54c79a655c49db82a0f879c5022fe7, State: Initialized, Role: FOLLOWER
I20260812 06:37:31.911875  5133 ts_tablet_manager.cc:1434] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:37:31.911875  5135 ts_tablet_manager.cc:1434] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:37:31.912092  5134 consensus_queue.cc:260] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.912276  5108 heartbeater.cc:499] Master 127.28.177.190:45679 was elected leader, sending a full tablet report...
I20260812 06:37:31.912530  4661 heartbeater.cc:499] Master 127.28.177.190:45679 was elected leader, sending a full tablet report...
I20260812 06:37:31.912823  4958 heartbeater.cc:499] Master 127.28.177.190:45679 was elected leader, sending a full tablet report...
I20260812 06:37:31.912976  5134 ts_tablet_manager.cc:1434] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
W20260812 06:37:31.935207  4960 tablet.cc:2406] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:31.947240  4903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cdc795a39f64cf7919a0fd9eb32b227"
dest_uuid: "0a54c79a655c49db82a0f879c5022fe7"
 from {username='slave'} at 127.0.0.1:58674
I20260812 06:37:31.947454  4903 raft_consensus.cc:493] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:37:31.947580  4903 raft_consensus.cc:3060] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:31.948592  4903 raft_consensus.cc:515] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.949589  4903 leader_election.cc:290] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [CANDIDATE]: Term 1 election: Requested vote from peers a907b61c31254a2a809637c29c5d6f95 (127.28.177.129:34645), ff05b0a45522423c8fb3673d1704c6da (127.28.177.132:46007)
I20260812 06:37:31.953275 29382 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 06:37:31.953912  5055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc795a39f64cf7919a0fd9eb32b227" candidate_uuid: "0a54c79a655c49db82a0f879c5022fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ff05b0a45522423c8fb3673d1704c6da"
I20260812 06:37:31.954107  5055 raft_consensus.cc:3060] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:31.954543  4608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdc795a39f64cf7919a0fd9eb32b227" candidate_uuid: "0a54c79a655c49db82a0f879c5022fe7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a907b61c31254a2a809637c29c5d6f95"
I20260812 06:37:31.954727  4608 raft_consensus.cc:3060] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:31.955385  5055 raft_consensus.cc:2468] T 0cdc795a39f64cf7919a0fd9eb32b227 P ff05b0a45522423c8fb3673d1704c6da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a54c79a655c49db82a0f879c5022fe7 in term 1.
I20260812 06:37:31.955842  4608 raft_consensus.cc:2468] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a54c79a655c49db82a0f879c5022fe7 in term 1.
I20260812 06:37:31.955858  4833 leader_election.cc:304] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a54c79a655c49db82a0f879c5022fe7, ff05b0a45522423c8fb3673d1704c6da; no voters: 
I20260812 06:37:31.956107  5142 raft_consensus.cc:2804] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:31.956362  5142 raft_consensus.cc:697] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: Becoming Leader. State: Replica: 0a54c79a655c49db82a0f879c5022fe7, State: Running, Role: LEADER
I20260812 06:37:31.956692  5142 consensus_queue.cc:237] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:31.959779  4440 catalog_manager.cc:5719] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a54c79a655c49db82a0f879c5022fe7 (127.28.177.131). New cstate: current_term: 1 leader_uuid: "0a54c79a655c49db82a0f879c5022fe7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:32.012966  5142 consensus_queue.cc:1048] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:32.018256  5142 consensus_queue.cc:1048] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:37:34.077912  4830 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.28.177.129:34645 timed out after 2.000s (SENT)
W20260812 06:37:36.079702  4830 consensus_peers.cc:597] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 -> Peer a907b61c31254a2a809637c29c5d6f95 (127.28.177.129:34645): Couldn't send request to peer a907b61c31254a2a809637c29c5d6f95. Status: Timed out: UpdateConsensus RPC to 127.28.177.129:34645 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:36.080255  4833 consensus_peers.cc:597] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 -> Peer ff05b0a45522423c8fb3673d1704c6da (127.28.177.132:46007): Couldn't send request to peer ff05b0a45522423c8fb3673d1704c6da. Status: Timed out: UpdateConsensus RPC to 127.28.177.132:46007 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:36.100670  5157 consensus_queue.cc:579] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Leader has been unable to successfully communicate with peer a907b61c31254a2a809637c29c5d6f95 for more than 3 seconds (4.079s)
I20260812 06:37:36.104220  4903 consensus_queue.cc:237] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: NON_VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: true } }
W20260812 06:37:36.109906  4831 consensus_peers.cc:597] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 -> Peer 8223c8402fc14e658b387db94ca2e99a (127.28.177.130:38043): Couldn't send request to peer 8223c8402fc14e658b387db94ca2e99a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cdc795a39f64cf7919a0fd9eb32b227. This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:36.146108  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.161847  5165 ts_tablet_manager.cc:933] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Initiating tablet copy from peer 0a54c79a655c49db82a0f879c5022fe7 (127.28.177.131:37293)
I20260812 06:37:36.162484  5165 tablet_copy_client.cc:323] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.177.131:37293
I20260812 06:37:36.166427  4927 tablet_copy_service.cc:140] P 0a54c79a655c49db82a0f879c5022fe7: Received BeginTabletCopySession request for tablet 0cdc795a39f64cf7919a0fd9eb32b227 from peer 8223c8402fc14e658b387db94ca2e99a ({username='slave'} at 127.28.177.130:59135)
I20260812 06:37:36.166545  4927 tablet_copy_service.cc:161] P 0a54c79a655c49db82a0f879c5022fe7: Beginning new tablet copy session on tablet 0cdc795a39f64cf7919a0fd9eb32b227 from peer 8223c8402fc14e658b387db94ca2e99a at {username='slave'} at 127.28.177.130:59135: session id = 8223c8402fc14e658b387db94ca2e99a-0cdc795a39f64cf7919a0fd9eb32b227
I20260812 06:37:36.167673  4927 tablet_copy_source_session.cc:215] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:36.171027  5165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdc795a39f64cf7919a0fd9eb32b227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:36.175590  5165 tablet_copy_client.cc:806] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:36.175890  5165 tablet_copy_client.cc:670] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:36.177740  5165 tablet_copy_client.cc:538] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:36.179257  5165 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Bootstrap starting.
I20260812 06:37:36.183434  5165 log.cc:826] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:36.185602  5165 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:36.185933  5165 tablet_bootstrap.cc:492] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Bootstrap complete.
I20260812 06:37:36.186208  5165 ts_tablet_manager.cc:1403] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Time spent bootstrapping tablet: real 0.007s	user 0.000s	sys 0.006s
I20260812 06:37:36.188501  5165 raft_consensus.cc:359] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } }
I20260812 06:37:36.188922  5165 raft_consensus.cc:740] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8223c8402fc14e658b387db94ca2e99a, State: Initialized, Role: LEARNER
I20260812 06:37:36.189213  5165 consensus_queue.cc:260] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: NON_VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: true } }
I20260812 06:37:36.189913  4811 heartbeater.cc:499] Master 127.28.177.190:45679 was elected leader, sending a full tablet report...
I20260812 06:37:36.190074  5165 ts_tablet_manager.cc:1434] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.004s
I20260812 06:37:36.190810  4927 tablet_copy_service.cc:342] P 0a54c79a655c49db82a0f879c5022fe7: Request end of tablet copy session 8223c8402fc14e658b387db94ca2e99a-0cdc795a39f64cf7919a0fd9eb32b227 received from {username='slave'} at 127.28.177.130:59135
I20260812 06:37:36.190932  4927 tablet_copy_service.cc:434] P 0a54c79a655c49db82a0f879c5022fe7: ending tablet copy session 8223c8402fc14e658b387db94ca2e99a-0cdc795a39f64cf7919a0fd9eb32b227 on tablet 0cdc795a39f64cf7919a0fd9eb32b227 with peer 8223c8402fc14e658b387db94ca2e99a
W20260812 06:37:36.192770  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.211843  4758 raft_consensus.cc:1217] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260812 06:37:36.254181  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.272287  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.294035  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.313562  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.333560  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.354290  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.389285  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.405293  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.444836  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.451228  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:36.494993  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.500566  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.532511  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.552242  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.578552  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.604214  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.619464  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.654964  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.674465  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.695851  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.731343  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.757473  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.774349  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.815559  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.825376  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.877358  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.884351  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.918040  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:36.921912  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:36.963879  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:36.979787  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.012051  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.024471  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.062047  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.077343  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.113112  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.119848  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.166285  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.178610  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.211197  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.224325  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.262049  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.275034  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.303719  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.326821  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.341398  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.371526  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.396394  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.417258  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.456619  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.474074  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.504732  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.533011  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.544508  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.575951  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.603929  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.624547  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.658769  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.679510  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.698786  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.726230  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.751652  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.769882  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.795674  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.811426  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.842592  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.850965  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.894556  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.900749  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.937530  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:37.948290  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:37.980888  5159 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.004312  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.031898  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.063211  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.093279  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.102109  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.144506  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.161957  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.198653  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.209722  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.237445  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.258481  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.276674  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.308485  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.324769  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.354192  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.383105  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.405833  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.426916  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.448411  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.478978  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.494247  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.528352  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.531500  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.577481  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.582373  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.625401  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.640130  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.678690  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.701251  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.729815  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.747071  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.776880  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.787918  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.827998  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.835563  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.882037  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.887382  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 06:37:38.934274  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:38.937280  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:38.981511  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:38.989184  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 06:37:39.035969  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.041620  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.088917  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.095474  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.143639  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.148432  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:39.187445  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.195506  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.232530  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.255329  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.280592  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.314985  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.325618  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.355541  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.382687  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.411206  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.422657  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.463117  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.469694  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.511781  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.516427  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.556531  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.572607  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.614337  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.616526  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.651904  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.655557  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:39.708761  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.709861  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.757923  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.760797  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.800912  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.819656  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.843025  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.870323  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.886426  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.917073  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.947515  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:39.955790  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:39.989892  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:40.001557  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:40.040004  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:40.059525  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 06:37:40.090294  5171 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:40.103356  4834 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 06:37:40.107191  4833 consensus_peers.cc:597] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 -> Peer ff05b0a45522423c8fb3673d1704c6da (127.28.177.132:46007): Couldn't send request to peer ff05b0a45522423c8fb3673d1704c6da. Status: Timed out: UpdateConsensus RPC to 127.28.177.132:46007 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:40.107458  4830 consensus_peers.cc:597] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 -> Peer a907b61c31254a2a809637c29c5d6f95 (127.28.177.129:34645): Couldn't send request to peer a907b61c31254a2a809637c29c5d6f95. Status: Timed out: UpdateConsensus RPC to 127.28.177.129:34645 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:40.113540  5171 consensus_queue.cc:579] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Leader has been unable to successfully communicate with peer a907b61c31254a2a809637c29c5d6f95 for more than 3 seconds (4.009s)
I20260812 06:37:40.139441  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.160514  5173 consensus_queue.cc:579] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Leader has been unable to successfully communicate with peer ff05b0a45522423c8fb3673d1704c6da for more than 3 seconds (4.056s)
I20260812 06:37:40.190609  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.228499  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.276764  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.328934  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.387008  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.432344  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.479283  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.519181  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.560456  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.614925  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.656008  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.708289  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.748114  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.799443  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.843557  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.896704  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:40.952731  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.005992  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.051203  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.107627  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.168855  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.212920  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.259984  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.311095  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.363282  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.421393  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.461645  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.516806  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.568068  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.626442  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.667305  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.726596  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.768464  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.820659  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.861442  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.911430  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:41.951249  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.007236  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.067332  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 06:37:42.115188  4830 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.28.177.129:34645 timed out after 2.000s (SENT) [suppressed 4 similar messages]
I20260812 06:37:42.128156  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.169191  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.209882  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.247746  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.291915  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.349936  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.398833  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.440929  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.486965  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.536178  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.579206  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.624250  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.681236  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.742444  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.793699  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.852861  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.912187  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:42.972548  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.026767  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.067744  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.125833  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.169801  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.229135  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.270391  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.327486  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.381572  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.430553  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.482628  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.531433  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.570645  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.613605  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.652601  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.705883  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.745806  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.787672  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.831471  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.870414  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.927386  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:43.970332  5157 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:44.032512  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:44.082808  4606 raft_consensus.cc:1275] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 1 FOLLOWER]: Refusing update from remote peer 0a54c79a655c49db82a0f879c5022fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:44.085044  5173 raft_consensus.cc:1027] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: attempt to promote peer 8223c8402fc14e658b387db94ca2e99a: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 06:37:44.085209  4601 raft_consensus.cc:1217] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 06:37:44.086211  5157 raft_consensus.cc:2955] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8223c8402fc14e658b387db94ca2e99a (127.28.177.130) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: NON_VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: true } } }
I20260812 06:37:44.086681  4608 raft_consensus.cc:2955] T 0cdc795a39f64cf7919a0fd9eb32b227 P a907b61c31254a2a809637c29c5d6f95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8223c8402fc14e658b387db94ca2e99a (127.28.177.130) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: NON_VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: true } } }
I20260812 06:37:44.087855  5157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58660 (request call id 1) took 7984 ms. Trace:
I20260812 06:37:44.088028  5157 rpcz_store.cc:276] 0812 06:37:36.103374 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:36.103458 (+    84us) service_pool.cc:224] Handling call
0812 06:37:36.105105 (+  1647us) log.cc:844] Serialized 509 byte log entry
0812 06:37:44.087840 (+7982735us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":67,"raft.queue_time_us":381,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":667,"spinlock_wait_cycles":4480,"thread_start_us":69,"threads_started":1,"wal-append.queue_time_us":172,"wal-append.run_cpu_time_us":409,"wal-append.run_wall_time_us":1000483}
I20260812 06:37:44.088891  4424 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 0cdc795a39f64cf7919a0fd9eb32b227 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 06:37:44.089906 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4508
I20260812 06:37:44.090704  4758 raft_consensus.cc:2955] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8223c8402fc14e658b387db94ca2e99a (127.28.177.130) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: NON_VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: true } } }
I20260812 06:37:44.093587  5178 raft_consensus.cc:1064] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7: attempting to promote NON_VOTER 8223c8402fc14e658b387db94ca2e99a to VOTER
I20260812 06:37:44.094116  5178 consensus_queue.cc:237] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: false } }
I20260812 06:37:44.094455  4438 catalog_manager.cc:5719] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 reported cstate change: config changed from index -1 to 2, NON_VOTER 8223c8402fc14e658b387db94ca2e99a (127.28.177.130) added. New cstate: current_term: 1 leader_uuid: "0a54c79a655c49db82a0f879c5022fe7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0a54c79a655c49db82a0f879c5022fe7" member_type: VOTER last_known_addr { host: "127.28.177.131" port: 37293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a907b61c31254a2a809637c29c5d6f95" member_type: VOTER last_known_addr { host: "127.28.177.129" port: 34645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff05b0a45522423c8fb3673d1704c6da" member_type: VOTER last_known_addr { host: "127.28.177.132" port: 46007 } health_report { overall_health: FAILED } } peers { permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: NON_VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.095933  4758 raft_consensus.cc:1275] T 0cdc795a39f64cf7919a0fd9eb32b227 P 8223c8402fc14e658b387db94ca2e99a [term 1 LEARNER]: Refusing update from remote peer 0a54c79a655c49db82a0f879c5022fe7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 06:37:44.096426  5178 consensus_queue.cc:1048] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8223c8402fc14e658b387db94ca2e99a" member_type: VOTER last_known_addr { host: "127.28.177.130" port: 38043 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260812 06:37:44.102597  4830 connection.cc:573] client connection to 127.28.177.129:34645 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:44.103052 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4664
W20260812 06:37:44.105847  4830 consensus_peers.cc:597] T 0cdc795a39f64cf7919a0fd9eb32b227 P 0a54c79a655c49db82a0f879c5022fe7 -> Peer a907b61c31254a2a809637c29c5d6f95 (127.28.177.129:34645): Couldn't send request to peer a907b61c31254a2a809637c29c5d6f95. Status: Network error: Client connection negotiation failed: client connection to 127.28.177.129:34645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:44.117128 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4814
I20260812 06:37:44.128806 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4963
I20260812 06:37:44.139287 29382 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskfQ8YU0/build/debug/bin/kudu with pid 4402
2026-08-12T06:37:44Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/1 (13235 ms)
[----------] 4 tests from DontEvictIfRemainingConfigIsUnstableITest (53213 ms total)

[----------] Global test environment tear-down
[==========] 10 tests from 3 test suites ran. (94705 ms total)
[  PASSED  ] 10 tests.
