[==========] Running 10 tests from 3 test suites.
[----------] Global test environment set-up.
[----------] 4 tests from TabletReplacementITest
[ RUN      ] TabletReplacementITest.TestMasterTombstoneEvictedReplica
2026-08-12T08:01:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:07Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:01:07.503319 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:32923
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:32923
--master_add_server_when_underreplicated=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:01:07.621222 30498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:07.621465 30498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:07.621507 30498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:07.625204 30498 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:07.625269 30498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:07.625293 30498 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:07.625312 30498 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:07.629662 30498 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:32923
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:32923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.30498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:07.630882 30498 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:07.632243 30498 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:07.639578 30498 server_base.cc:1061] running on GCE node
W20260812 08:01:07.639576 30504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:07.639848 30507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:07.640359 30505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:07.640873 30498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:07.641852 30498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:07.643082 30498 hybrid_clock.cc:648] HybridClock initialized: now 1786521667643044 us; error 50 us; skew 500 ppm
I20260812 08:01:07.645089 30498 webserver.cc:533] Webserver started at http://127.29.198.62:33661/ using document root <none> and password file <none>
I20260812 08:01:07.645744 30498 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:07.645828 30498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:07.646051 30498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:07.647634 30498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "ee6f834edb60493186805e4d0c6d5472"
format_stamp: "Formatted at 2026-08-12 08:01:07 on dist-test-slave-1zqn"
I20260812 08:01:07.648202 30498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "ee6f834edb60493186805e4d0c6d5472"
format_stamp: "Formatted at 2026-08-12 08:01:07 on dist-test-slave-1zqn"
I20260812 08:01:07.651504 30498 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:07.653803 30513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:07.655049 30498 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:01:07.655187 30498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "ee6f834edb60493186805e4d0c6d5472"
format_stamp: "Formatted at 2026-08-12 08:01:07 on dist-test-slave-1zqn"
I20260812 08:01:07.655306 30498 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:07.691027 30498 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:07.691746 30498 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:07.691910 30498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:07.700870 30575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:32923 every 8 connection(s)
I20260812 08:01:07.700881 30498 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:32923
I20260812 08:01:07.702080 30498 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:07.705399 30576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:07.709712 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 30498
I20260812 08:01:07.709837 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:07.711054 30576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472: Bootstrap starting.
I20260812 08:01:07.714068 30576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:07.715034 30576 log.cc:826] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:07.717172 30576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472: No bootstrap required, opened a new log
I20260812 08:01:07.720530 30576 raft_consensus.cc:359] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6f834edb60493186805e4d0c6d5472" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32923 } }
I20260812 08:01:07.720911 30576 raft_consensus.cc:385] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:07.720981 30576 raft_consensus.cc:740] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6f834edb60493186805e4d0c6d5472, State: Initialized, Role: FOLLOWER
I20260812 08:01:07.721551 30576 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6f834edb60493186805e4d0c6d5472" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32923 } }
I20260812 08:01:07.721760 30576 raft_consensus.cc:399] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:07.721838 30576 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:07.722003 30576 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:07.723084 30576 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6f834edb60493186805e4d0c6d5472" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32923 } }
I20260812 08:01:07.723388 30576 leader_election.cc:304] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6f834edb60493186805e4d0c6d5472; no voters: 
I20260812 08:01:07.723646 30576 leader_election.cc:290] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:07.723812 30581 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:07.724032 30581 raft_consensus.cc:697] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [term 1 LEADER]: Becoming Leader. State: Replica: ee6f834edb60493186805e4d0c6d5472, State: Running, Role: LEADER
I20260812 08:01:07.724423 30581 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6f834edb60493186805e4d0c6d5472" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32923 } }
I20260812 08:01:07.724927 30576 sys_catalog.cc:565] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:07.726832 30583 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee6f834edb60493186805e4d0c6d5472" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6f834edb60493186805e4d0c6d5472" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32923 } } }
I20260812 08:01:07.726950 30583 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:07.728310 30584 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6f834edb60493186805e4d0c6d5472. Latest consensus state: current_term: 1 leader_uuid: "ee6f834edb60493186805e4d0c6d5472" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6f834edb60493186805e4d0c6d5472" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32923 } } }
I20260812 08:01:07.728597 30584 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472 [sys.catalog]: This master's current role is: LEADER
W20260812 08:01:07.731065 30605 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:07.731143 30605 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:07.731201 30594 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:07.732168 30594 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:07.737743 30594 catalog_manager.cc:1383] Generated new cluster ID: bf784a2dd6aa4aa585fb7f6c49be39e5
I20260812 08:01:07.737836 30594 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:07.745589 30594 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:07.746469 30594 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:07.760226 30594 catalog_manager.cc:6092] T 00000000000000000000000000000000 P ee6f834edb60493186805e4d0c6d5472: Generated new TSK 0
I20260812 08:01:07.761119 30594 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:07.769613 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--builtin_ntp_servers=127.29.198.20:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:07.880030 30608 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:07.880363 30608 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:07.880412 30608 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:07.880493 30608 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:07.883888 30608 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:07.884109 30608 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:07.888175 30608 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--never_fsync=true
--heap_profile_path=/tmp/kudu.30608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:07.889308 30608 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:07.890522 30608 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:07.897843 30614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:07.897841 30617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:07.897841 30615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:07.898622 30608 server_base.cc:1061] running on GCE node
I20260812 08:01:07.899003 30608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:07.899611 30608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:07.900779 30608 hybrid_clock.cc:648] HybridClock initialized: now 1786521667900765 us; error 34 us; skew 500 ppm
I20260812 08:01:07.902693 30608 webserver.cc:533] Webserver started at http://127.29.198.1:43021/ using document root <none> and password file <none>
I20260812 08:01:07.903259 30608 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:07.903312 30608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:07.903476 30608 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:07.905153 30608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "72c54b95521247a1a7c9beb48ebd7e7d"
format_stamp: "Formatted at 2026-08-12 08:01:07 on dist-test-slave-1zqn"
I20260812 08:01:07.905689 30608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "72c54b95521247a1a7c9beb48ebd7e7d"
format_stamp: "Formatted at 2026-08-12 08:01:07 on dist-test-slave-1zqn"
I20260812 08:01:07.909276 30608 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:07.911463 30623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:07.912578 30608 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:07.912700 30608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "72c54b95521247a1a7c9beb48ebd7e7d"
format_stamp: "Formatted at 2026-08-12 08:01:07 on dist-test-slave-1zqn"
I20260812 08:01:07.912802 30608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:07.956607 30608 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:07.957343 30608 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:07.957543 30608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:07.958169 30608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:07.959265 30608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:07.959335 30608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:07.959404 30608 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:07.959452 30608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:07.973246 30608 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:44617
I20260812 08:01:07.973270 30758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:44617 every 8 connection(s)
I20260812 08:01:07.974339 30608 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:07.977409 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 30608
I20260812 08:01:07.977526 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:07.979846 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--builtin_ntp_servers=127.29.198.20:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:07.984871 30762 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32923
I20260812 08:01:07.985211 30762 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:07.985991 30762 heartbeater.cc:507] Master 127.29.198.62:32923 requested a full tablet report, sending...
I20260812 08:01:07.987697 30531 ts_manager.cc:194] Registered new tserver with Master: 72c54b95521247a1a7c9beb48ebd7e7d (127.29.198.1:44617)
I20260812 08:01:07.989024 30531 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:35867
W20260812 08:01:08.090809 30766 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:08.091084 30766 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:08.091136 30766 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:08.091214 30766 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:08.094662 30766 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:08.094847 30766 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:08.098685 30766 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--never_fsync=true
--heap_profile_path=/tmp/kudu.30766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:08.099804 30766 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:08.101017 30766 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:08.107852 30775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:08.107797 30772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:08.107795 30773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:08.108016 30766 server_base.cc:1061] running on GCE node
I20260812 08:01:08.108615 30766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:08.109189 30766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:08.110533 30766 hybrid_clock.cc:648] HybridClock initialized: now 1786521668110501 us; error 47 us; skew 500 ppm
I20260812 08:01:08.112643 30766 webserver.cc:533] Webserver started at http://127.29.198.2:44891/ using document root <none> and password file <none>
I20260812 08:01:08.113236 30766 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:08.113320 30766 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:08.113544 30766 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:08.115234 30766 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "c270387aa93341aba54a9616cd8cb721"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.115744 30766 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "c270387aa93341aba54a9616cd8cb721"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.119585 30766 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:08.121891 30783 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.122989 30766 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:08.123142 30766 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "c270387aa93341aba54a9616cd8cb721"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.123251 30766 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:08.141132 30766 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:08.141788 30766 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:08.141978 30766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:08.142653 30766 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:08.143721 30766 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:08.143792 30766 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.143872 30766 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:08.143916 30766 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.159502 30766 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:42431
I20260812 08:01:08.159519 30913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:42431 every 8 connection(s)
I20260812 08:01:08.160670 30766 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:08.168890 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 30766
I20260812 08:01:08.169023 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:08.170281 30916 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32923
I20260812 08:01:08.170560 30916 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:08.171118 30916 heartbeater.cc:507] Master 127.29.198.62:32923 requested a full tablet report, sending...
I20260812 08:01:08.171296 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--builtin_ntp_servers=127.29.198.20:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:08.172608 30531 ts_manager.cc:194] Registered new tserver with Master: c270387aa93341aba54a9616cd8cb721 (127.29.198.2:42431)
I20260812 08:01:08.173713 30531 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:45349
W20260812 08:01:08.286294 30919 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:08.286517 30919 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:08.286540 30919 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:08.286578 30919 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:08.289951 30919 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:08.290062 30919 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:08.293762 30919 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--never_fsync=true
--heap_profile_path=/tmp/kudu.30919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:08.294869 30919 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:08.296088 30919 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:08.302759 30925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:08.302801 30927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:08.303164 30919 server_base.cc:1061] running on GCE node
W20260812 08:01:08.302814 30924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:08.303552 30919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:08.304131 30919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:08.305333 30919 hybrid_clock.cc:648] HybridClock initialized: now 1786521668305298 us; error 31 us; skew 500 ppm
I20260812 08:01:08.307106 30919 webserver.cc:533] Webserver started at http://127.29.198.3:39383/ using document root <none> and password file <none>
I20260812 08:01:08.307672 30919 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:08.307726 30919 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:08.307941 30919 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:08.309504 30919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "a22f51cb25cd435c821b2ee7b11ca910"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.310191 30919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "a22f51cb25cd435c821b2ee7b11ca910"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.313731 30919 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:08.315917 30933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.317109 30919 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:08.317250 30919 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "a22f51cb25cd435c821b2ee7b11ca910"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.317349 30919 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:08.336627 30919 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:08.337339 30919 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:08.337539 30919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:08.338258 30919 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:08.339402 30919 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:08.339452 30919 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.339521 30919 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:08.339565 30919 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.355872 30919 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:42829
I20260812 08:01:08.355895 31070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:42829 every 8 connection(s)
I20260812 08:01:08.357016 30919 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:08.360898 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 30919
I20260812 08:01:08.361009 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:08.363085 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.4:0
--local_ip_for_outbound_sockets=127.29.198.4
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--builtin_ntp_servers=127.29.198.20:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:08.367446 31071 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32923
I20260812 08:01:08.367697 31071 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:08.368297 31071 heartbeater.cc:507] Master 127.29.198.62:32923 requested a full tablet report, sending...
I20260812 08:01:08.369410 30531 ts_manager.cc:194] Registered new tserver with Master: a22f51cb25cd435c821b2ee7b11ca910 (127.29.198.3:42829)
I20260812 08:01:08.370257 30531 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:47873
W20260812 08:01:08.475657 31074 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:08.475890 31074 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:08.475912 31074 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:08.475953 31074 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:08.479245 31074 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:08.479357 31074 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.4
I20260812 08:01:08.483191 31074 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--never_fsync=true
--heap_profile_path=/tmp/kudu.31074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:08.484316 31074 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:08.485424 31074 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:08.492305 31084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:08.492313 31081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:08.492362 31082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:08.492496 31074 server_base.cc:1061] running on GCE node
I20260812 08:01:08.492949 31074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:08.493530 31074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:08.494748 31074 hybrid_clock.cc:648] HybridClock initialized: now 1786521668494726 us; error 33 us; skew 500 ppm
I20260812 08:01:08.496691 31074 webserver.cc:533] Webserver started at http://127.29.198.4:33069/ using document root <none> and password file <none>
I20260812 08:01:08.497352 31074 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:08.497437 31074 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:08.497666 31074 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:08.499266 31074 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data/instance:
uuid: "ee12e5854e1941dd8a38647a066b4e3b"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.499826 31074 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance:
uuid: "ee12e5854e1941dd8a38647a066b4e3b"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.503438 31074 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:08.505728 31091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.506767 31074 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:01:08.506922 31074 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal
uuid: "ee12e5854e1941dd8a38647a066b4e3b"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.507023 31074 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:08.535277 31074 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:08.536000 31074 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:08.536235 31074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:08.536914 31074 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:08.538113 31074 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:08.538184 31074 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.538254 31074 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:08.538298 31074 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.553038 31074 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.4:34459
I20260812 08:01:08.553063 31228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.4:34459 every 8 connection(s)
I20260812 08:01:08.554075 31074 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
I20260812 08:01:08.561666 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 31074
I20260812 08:01:08.561795 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance
I20260812 08:01:08.563665 31229 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32923
I20260812 08:01:08.563920 31229 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:08.564153 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.5:0
--local_ip_for_outbound_sockets=127.29.198.5
--webserver_interface=127.29.198.5
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--builtin_ntp_servers=127.29.198.20:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:08.564572 31229 heartbeater.cc:507] Master 127.29.198.62:32923 requested a full tablet report, sending...
I20260812 08:01:08.565721 30531 ts_manager.cc:194] Registered new tserver with Master: ee12e5854e1941dd8a38647a066b4e3b (127.29.198.4:34459)
I20260812 08:01:08.566711 30531 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.4:44277
W20260812 08:01:08.676172 31232 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:08.676399 31232 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:08.676445 31232 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:08.676534 31232 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:08.679831 31232 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:08.679991 31232 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.5
I20260812 08:01:08.683842 31232 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.5:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data/info.pb
--webserver_interface=127.29.198.5
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32923
--never_fsync=true
--heap_profile_path=/tmp/kudu.31232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.5

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:08.685009 31232 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:08.686149 31232 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:08.692891 31239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:08.693051 31232 server_base.cc:1061] running on GCE node
W20260812 08:01:08.692905 31243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:08.692947 31240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:08.693486 31232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:08.694079 31232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:08.695237 31232 hybrid_clock.cc:648] HybridClock initialized: now 1786521668695200 us; error 46 us; skew 500 ppm
I20260812 08:01:08.697885 31232 webserver.cc:533] Webserver started at http://127.29.198.5:41111/ using document root <none> and password file <none>
I20260812 08:01:08.698719 31232 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:08.698800 31232 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:08.699074 31232 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:08.701527 31232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data/instance:
uuid: "8c188cb26eb74d90b0c68f26becc454e"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.702690 31232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal/instance:
uuid: "8c188cb26eb74d90b0c68f26becc454e"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.707432 31232 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:08.710606 31251 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.711851 31232 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:01:08.711977 31232 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal
uuid: "8c188cb26eb74d90b0c68f26becc454e"
format_stamp: "Formatted at 2026-08-12 08:01:08 on dist-test-slave-1zqn"
I20260812 08:01:08.712116 31232 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:08.760273 31232 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:08.761252 31232 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:08.761492 31232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:08.762445 31232 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:08.764145 31232 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:08.764235 31232 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.764304 31232 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:08.764346 31232 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:08.785552 31232 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.5:46791
I20260812 08:01:08.785576 31396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.5:46791 every 8 connection(s)
I20260812 08:01:08.787158 31232 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/data/info.pb
I20260812 08:01:08.793469 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 31232
I20260812 08:01:08.793632 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal/instance
I20260812 08:01:08.797895 31397 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32923
I20260812 08:01:08.798164 31397 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:08.798698 31397 heartbeater.cc:507] Master 127.29.198.62:32923 requested a full tablet report, sending...
I20260812 08:01:08.799763 30531 ts_manager.cc:194] Registered new tserver with Master: 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5:46791)
I20260812 08:01:08.800365 30531 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.5:38041
I20260812 08:01:08.808864 30488 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 08:01:08.838601 30531 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:08.840312 30531 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260812 08:01:08.862154 30678 tablet_service.cc:1511] Processing CreateTablet for tablet 8db164de8ee649f3baad6e3405a2895f (DEFAULT_TABLE table=test-workload [id=2158568e7ae54e7687375cac32e75e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:08.862598 31155 tablet_service.cc:1511] Processing CreateTablet for tablet 8db164de8ee649f3baad6e3405a2895f (DEFAULT_TABLE table=test-workload [id=2158568e7ae54e7687375cac32e75e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:08.863226 30678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db164de8ee649f3baad6e3405a2895f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:08.863490 31155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db164de8ee649f3baad6e3405a2895f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:08.866729 30990 tablet_service.cc:1511] Processing CreateTablet for tablet 8db164de8ee649f3baad6e3405a2895f (DEFAULT_TABLE table=test-workload [id=2158568e7ae54e7687375cac32e75e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:08.867676 30990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db164de8ee649f3baad6e3405a2895f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:08.869387 31314 tablet_service.cc:1511] Processing CreateTablet for tablet 8db164de8ee649f3baad6e3405a2895f (DEFAULT_TABLE table=test-workload [id=2158568e7ae54e7687375cac32e75e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:08.870421 31314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db164de8ee649f3baad6e3405a2895f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:08.877744 31430 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: Bootstrap starting.
I20260812 08:01:08.878094 31432 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Bootstrap starting.
I20260812 08:01:08.880224 31430 tablet_bootstrap.cc:654] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:08.880292 31432 tablet_bootstrap.cc:654] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:08.880142 30833 tablet_service.cc:1511] Processing CreateTablet for tablet 8db164de8ee649f3baad6e3405a2895f (DEFAULT_TABLE table=test-workload [id=2158568e7ae54e7687375cac32e75e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:08.881008 31430 log.cc:826] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:08.881083 31432 log.cc:826] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:08.881176 30833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db164de8ee649f3baad6e3405a2895f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:08.882149 31431 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: Bootstrap starting.
I20260812 08:01:08.883059 31432 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: No bootstrap required, opened a new log
I20260812 08:01:08.883260 31432 ts_tablet_manager.cc:1403] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:08.884004 31431 tablet_bootstrap.cc:654] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:08.884713 31431 log.cc:826] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:08.886611 31431 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: No bootstrap required, opened a new log
I20260812 08:01:08.886494 31432 raft_consensus.cc:359] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.886726 31432 raft_consensus.cc:740] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c188cb26eb74d90b0c68f26becc454e, State: Initialized, Role: FOLLOWER
I20260812 08:01:08.886941 31431 ts_tablet_manager.cc:1403] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 08:01:08.887060 31432 consensus_queue.cc:260] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.887979 31438 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: Bootstrap starting.
I20260812 08:01:08.888142 31432 ts_tablet_manager.cc:1434] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:01:08.888501 31397 heartbeater.cc:499] Master 127.29.198.62:32923 was elected leader, sending a full tablet report...
I20260812 08:01:08.890596 31438 tablet_bootstrap.cc:654] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:08.891528 31438 log.cc:826] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:08.892606 31430 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: No bootstrap required, opened a new log
I20260812 08:01:08.892807 31430 ts_tablet_manager.cc:1403] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.004s
I20260812 08:01:08.893162 31431 raft_consensus.cc:359] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.893391 31431 raft_consensus.cc:740] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a22f51cb25cd435c821b2ee7b11ca910, State: Initialized, Role: FOLLOWER
I20260812 08:01:08.893702 31431 consensus_queue.cc:260] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.894184 31438 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: No bootstrap required, opened a new log
I20260812 08:01:08.894408 31438 ts_tablet_manager.cc:1403] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 08:01:08.894659 31431 ts_tablet_manager.cc:1434] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260812 08:01:08.894987 31071 heartbeater.cc:499] Master 127.29.198.62:32923 was elected leader, sending a full tablet report...
I20260812 08:01:08.895961 31430 raft_consensus.cc:359] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.896246 31430 raft_consensus.cc:740] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee12e5854e1941dd8a38647a066b4e3b, State: Initialized, Role: FOLLOWER
I20260812 08:01:08.896564 31430 consensus_queue.cc:260] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.897471 31430 ts_tablet_manager.cc:1434] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:08.897841 31229 heartbeater.cc:499] Master 127.29.198.62:32923 was elected leader, sending a full tablet report...
I20260812 08:01:08.897764 31438 raft_consensus.cc:359] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.897971 31438 raft_consensus.cc:740] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c270387aa93341aba54a9616cd8cb721, State: Initialized, Role: FOLLOWER
I20260812 08:01:08.898231 31438 consensus_queue.cc:260] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.898922 30916 heartbeater.cc:499] Master 127.29.198.62:32923 was elected leader, sending a full tablet report...
I20260812 08:01:08.899204 31438 ts_tablet_manager.cc:1434] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:08.906574 31434 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Bootstrap starting.
I20260812 08:01:08.909094 31434 tablet_bootstrap.cc:654] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:08.910048 31434 log.cc:826] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Log is configured to *not* fsync() on all Append() calls
W20260812 08:01:08.912220 30917 tablet.cc:2406] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:08.912299 31434 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: No bootstrap required, opened a new log
I20260812 08:01:08.912535 31434 ts_tablet_manager.cc:1403] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Time spent bootstrapping tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 08:01:08.916935 31434 raft_consensus.cc:359] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.917297 31434 raft_consensus.cc:740] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72c54b95521247a1a7c9beb48ebd7e7d, State: Initialized, Role: FOLLOWER
I20260812 08:01:08.917692 31434 consensus_queue.cc:260] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.918506 30762 heartbeater.cc:499] Master 127.29.198.62:32923 was elected leader, sending a full tablet report...
I20260812 08:01:08.918864 31434 ts_tablet_manager.cc:1434] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 08:01:08.948263 30702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8db164de8ee649f3baad6e3405a2895f"
dest_uuid: "72c54b95521247a1a7c9beb48ebd7e7d"
 from {username='slave'} at 127.0.0.1:44734
I20260812 08:01:08.948571 30702 raft_consensus.cc:493] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:08.948707 30702 raft_consensus.cc:3060] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:08.950368 30702 raft_consensus.cc:515] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.951712 30702 leader_election.cc:290] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [CANDIDATE]: Term 1 election: Requested vote from peers c270387aa93341aba54a9616cd8cb721 (127.29.198.2:42431), ee12e5854e1941dd8a38647a066b4e3b (127.29.198.4:34459), a22f51cb25cd435c821b2ee7b11ca910 (127.29.198.3:42829), 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5:46791)
I20260812 08:01:08.959916 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0 0.0 0.0
I20260812 08:01:08.960777 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db164de8ee649f3baad6e3405a2895f" candidate_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c270387aa93341aba54a9616cd8cb721"
I20260812 08:01:08.961041 30860 raft_consensus.cc:3060] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:08.961333 31343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db164de8ee649f3baad6e3405a2895f" candidate_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8c188cb26eb74d90b0c68f26becc454e"
I20260812 08:01:08.961314 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db164de8ee649f3baad6e3405a2895f" candidate_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a22f51cb25cd435c821b2ee7b11ca910"
I20260812 08:01:08.961534 31011 raft_consensus.cc:3060] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:08.961534 31343 raft_consensus.cc:3060] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:08.962812 31011 raft_consensus.cc:2468] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72c54b95521247a1a7c9beb48ebd7e7d in term 1.
I20260812 08:01:08.962812 31343 raft_consensus.cc:2468] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72c54b95521247a1a7c9beb48ebd7e7d in term 1.
I20260812 08:01:08.963173 30860 raft_consensus.cc:2468] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72c54b95521247a1a7c9beb48ebd7e7d in term 1.
I20260812 08:01:08.963426 30626 leader_election.cc:304] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 72c54b95521247a1a7c9beb48ebd7e7d, 8c188cb26eb74d90b0c68f26becc454e, a22f51cb25cd435c821b2ee7b11ca910; no voters: 
I20260812 08:01:08.963783 31451 raft_consensus.cc:2804] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:08.964232 31451 raft_consensus.cc:697] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 1 LEADER]: Becoming Leader. State: Replica: 72c54b95521247a1a7c9beb48ebd7e7d, State: Running, Role: LEADER
I20260812 08:01:08.964655 31451 consensus_queue.cc:237] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } }
I20260812 08:01:08.966293 31179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db164de8ee649f3baad6e3405a2895f" candidate_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ee12e5854e1941dd8a38647a066b4e3b"
I20260812 08:01:08.966529 31179 raft_consensus.cc:3060] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:08.968019 31179 raft_consensus.cc:2468] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72c54b95521247a1a7c9beb48ebd7e7d in term 1.
I20260812 08:01:08.969023 30530 catalog_manager.cc:5719] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72c54b95521247a1a7c9beb48ebd7e7d (127.29.198.1). New cstate: current_term: 1 leader_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } health_report { overall_health: UNKNOWN } } }
W20260812 08:01:08.975967 30763 tablet.cc:2406] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:09.038513 31398 tablet.cc:2406] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:09.055498 31230 tablet.cc:2406] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:09.064556 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0 0.0 0.0
W20260812 08:01:09.108862 31072 tablet.cc:2406] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:09.269187 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0 0.0 0.0
I20260812 08:01:09.382249 31451 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:09.492561 31451 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:09.498301 31465 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:09.499264 31461 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:09.575522 30702 consensus_queue.cc:237] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } }
I20260812 08:01:09.577168 31011 raft_consensus.cc:1275] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [term 1 FOLLOWER]: Refusing update from remote peer 72c54b95521247a1a7c9beb48ebd7e7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:09.577275 31179 raft_consensus.cc:1275] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [term 1 FOLLOWER]: Refusing update from remote peer 72c54b95521247a1a7c9beb48ebd7e7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:09.577596 31465 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:01:09.577630 30860 raft_consensus.cc:1275] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [term 1 FOLLOWER]: Refusing update from remote peer 72c54b95521247a1a7c9beb48ebd7e7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:09.578127 31461 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:01:09.578327 31465 consensus_queue.cc:1048] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:01:09.580297 31461 raft_consensus.cc:2955] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } }
I20260812 08:01:09.580864 30860 raft_consensus.cc:2955] T 8db164de8ee649f3baad6e3405a2895f P c270387aa93341aba54a9616cd8cb721 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } }
I20260812 08:01:09.582309 31179 raft_consensus.cc:2955] T 8db164de8ee649f3baad6e3405a2895f P ee12e5854e1941dd8a38647a066b4e3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } }
I20260812 08:01:09.582792 31011 raft_consensus.cc:2955] T 8db164de8ee649f3baad6e3405a2895f P a22f51cb25cd435c821b2ee7b11ca910 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } }
I20260812 08:01:09.583221 30530 catalog_manager.cc:5719] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d reported cstate change: config changed from index -1 to 2, VOTER 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5) evicted. New cstate: current_term: 1 leader_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } health_report { overall_health: HEALTHY } } }
I20260812 08:01:09.587783 31314 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db164de8ee649f3baad6e3405a2895f with delete_type TABLET_DATA_TOMBSTONED (TS 8c188cb26eb74d90b0c68f26becc454e not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:43026
I20260812 08:01:09.588526 31478 tablet_replica.cc:333] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: stopping tablet replica
I20260812 08:01:09.588845 31478 raft_consensus.cc:2243] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:01:09.589164 31478 raft_consensus.cc:2272] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:01:09.590416 31478 ts_tablet_manager.cc:1916] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:01:09.592523 31478 ts_tablet_manager.cc:1929] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:01:09.592634 31478 log.cc:1199] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Deleting WAL directory at /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneEvictedReplica.1786521667469487-30488-0/minicluster-data/ts-4/wal/wals/8db164de8ee649f3baad6e3405a2895f
I20260812 08:01:09.593298 30516 catalog_manager.cc:5050] TS 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5:46791): tablet 8db164de8ee649f3baad6e3405a2895f (table test-workload [id=2158568e7ae54e7687375cac32e75e5e]) successfully deleted
I20260812 08:01:09.595657 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 30766
I20260812 08:01:09.606631 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 30919
I20260812 08:01:09.619244 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 31074
I20260812 08:01:09.631078 30702 consensus_queue.cc:237] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } attrs { } }
W20260812 08:01:09.633409 30626 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42829: connect: Connection refused (error 111)
W20260812 08:01:09.634024 30626 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer 8c188cb26eb74d90b0c68f26becc454e (127.29.198.5:46791): Couldn't send request to peer 8c188cb26eb74d90b0c68f26becc454e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:09.634441 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer ee12e5854e1941dd8a38647a066b4e3b (127.29.198.4:34459): Couldn't send request to peer ee12e5854e1941dd8a38647a066b4e3b. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.4:34459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:09.634568 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer c270387aa93341aba54a9616cd8cb721 (127.29.198.2:42431): Couldn't send request to peer c270387aa93341aba54a9616cd8cb721. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:42431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:09.634617 30626 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer a22f51cb25cd435c821b2ee7b11ca910 (127.29.198.3:42829): Couldn't send request to peer a22f51cb25cd435c821b2ee7b11ca910. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:10.084445 31484 ts_tablet_manager.cc:933] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Initiating tablet copy from peer 72c54b95521247a1a7c9beb48ebd7e7d (127.29.198.1:44617)
I20260812 08:01:10.085206 31484 tablet_copy_client.cc:323] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.198.1:44617
I20260812 08:01:10.089193 30727 tablet_copy_service.cc:140] P 72c54b95521247a1a7c9beb48ebd7e7d: Received BeginTabletCopySession request for tablet 8db164de8ee649f3baad6e3405a2895f from peer 8c188cb26eb74d90b0c68f26becc454e ({username='slave'} at 127.29.198.5:36285)
I20260812 08:01:10.089368 30727 tablet_copy_service.cc:161] P 72c54b95521247a1a7c9beb48ebd7e7d: Beginning new tablet copy session on tablet 8db164de8ee649f3baad6e3405a2895f from peer 8c188cb26eb74d90b0c68f26becc454e at {username='slave'} at 127.29.198.5:36285: session id = 8c188cb26eb74d90b0c68f26becc454e-8db164de8ee649f3baad6e3405a2895f
I20260812 08:01:10.090695 30727 tablet_copy_source_session.cc:215] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:01:10.092337 31484 ts_tablet_manager.cc:1916] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:01:10.094556 31484 ts_tablet_manager.cc:1929] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260812 08:01:10.094769 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db164de8ee649f3baad6e3405a2895f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:10.095964 31484 tablet_copy_client.cc:806] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: tablet copy: Starting download of 0 data blocks...
I20260812 08:01:10.096171 31484 tablet_copy_client.cc:670] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: tablet copy: Starting download of 1 WAL segments...
I20260812 08:01:10.098040 31484 tablet_copy_client.cc:538] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:01:10.099428 31484 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Bootstrap starting.
I20260812 08:01:10.103893 31484 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:01:10.104264 31484 tablet_bootstrap.cc:492] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Bootstrap complete.
I20260812 08:01:10.104430 31484 ts_tablet_manager.cc:1403] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.004s
I20260812 08:01:10.104983 31484 raft_consensus.cc:359] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } }
I20260812 08:01:10.105252 31484 raft_consensus.cc:740] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c188cb26eb74d90b0c68f26becc454e, State: Initialized, Role: FOLLOWER
I20260812 08:01:10.105391 31484 consensus_queue.cc:260] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "72c54b95521247a1a7c9beb48ebd7e7d" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44617 } } peers { permanent_uuid: "c270387aa93341aba54a9616cd8cb721" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 42431 } } peers { permanent_uuid: "ee12e5854e1941dd8a38647a066b4e3b" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 34459 } } peers { permanent_uuid: "a22f51cb25cd435c821b2ee7b11ca910" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42829 } } peers { permanent_uuid: "8c188cb26eb74d90b0c68f26becc454e" member_type: VOTER last_known_addr { host: "127.29.198.5" port: 46791 } attrs { } }
I20260812 08:01:10.105780 31484 ts_tablet_manager.cc:1434] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:01:10.106535 30727 tablet_copy_service.cc:342] P 72c54b95521247a1a7c9beb48ebd7e7d: Request end of tablet copy session 8c188cb26eb74d90b0c68f26becc454e-8db164de8ee649f3baad6e3405a2895f received from {username='slave'} at 127.29.198.5:36285
I20260812 08:01:10.106662 30727 tablet_copy_service.cc:434] P 72c54b95521247a1a7c9beb48ebd7e7d: ending tablet copy session 8c188cb26eb74d90b0c68f26becc454e-8db164de8ee649f3baad6e3405a2895f on tablet 8db164de8ee649f3baad6e3405a2895f with peer 8c188cb26eb74d90b0c68f26becc454e
I20260812 08:01:10.539186 31343 raft_consensus.cc:1217] T 8db164de8ee649f3baad6e3405a2895f P 8c188cb26eb74d90b0c68f26becc454e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3]   Dedup: 1.3->[]
W20260812 08:01:11.995355 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer c270387aa93341aba54a9616cd8cb721 (127.29.198.2:42431): Couldn't send request to peer c270387aa93341aba54a9616cd8cb721. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:42431: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:01:12.203719 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer ee12e5854e1941dd8a38647a066b4e3b (127.29.198.4:34459): Couldn't send request to peer ee12e5854e1941dd8a38647a066b4e3b. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.4:34459: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:01:12.341260 30626 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer a22f51cb25cd435c821b2ee7b11ca910 (127.29.198.3:42829): Couldn't send request to peer a22f51cb25cd435c821b2ee7b11ca910. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42829: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:01:14.533680 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer c270387aa93341aba54a9616cd8cb721 (127.29.198.2:42431): Couldn't send request to peer c270387aa93341aba54a9616cd8cb721. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:42431: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:01:14.759661 30626 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42829: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20260812 08:01:14.760588 30626 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer a22f51cb25cd435c821b2ee7b11ca910 (127.29.198.3:42829): Couldn't send request to peer a22f51cb25cd435c821b2ee7b11ca910. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42829: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:01:15.134004 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer ee12e5854e1941dd8a38647a066b4e3b (127.29.198.4:34459): Couldn't send request to peer ee12e5854e1941dd8a38647a066b4e3b. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.4:34459: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:01:17.062237 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer c270387aa93341aba54a9616cd8cb721 (127.29.198.2:42431): Couldn't send request to peer c270387aa93341aba54a9616cd8cb721. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:42431: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:01:17.088694 30626 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer a22f51cb25cd435c821b2ee7b11ca910 (127.29.198.3:42829): Couldn't send request to peer a22f51cb25cd435c821b2ee7b11ca910. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42829: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:01:17.577836 30625 consensus_peers.cc:597] T 8db164de8ee649f3baad6e3405a2895f P 72c54b95521247a1a7c9beb48ebd7e7d -> Peer ee12e5854e1941dd8a38647a066b4e3b (127.29.198.4:34459): Couldn't send request to peer ee12e5854e1941dd8a38647a066b4e3b. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.4:34459: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 08:01:17.636147 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 30608
I20260812 08:01:17.647368 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 31232
I20260812 08:01:17.657299 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 30498
2026-08-12T08:01:17Z chronyd exiting
[       OK ] TabletReplacementITest.TestMasterTombstoneEvictedReplica (10203 ms)
[ RUN      ] TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport
2026-08-12T08:01:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:17Z Disabled control of system clock
I20260812 08:01:17.693934 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:45605
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:45605
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 08:01:17.803841 31498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:17.804148 31498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:17.804194 31498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:17.807534 31498 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:17.807611 31498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:17.807636 31498 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:17.807657 31498 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:17.811691 31498 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:45605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:45605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:17.812817 31498 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:17.813939 31498 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:17.820236 31506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.820322 31508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.820232 31505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.820502 31498 server_base.cc:1061] running on GCE node
I20260812 08:01:17.821043 31498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:17.822021 31498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:17.823230 31498 hybrid_clock.cc:648] HybridClock initialized: now 1786521677823196 us; error 41 us; skew 500 ppm
I20260812 08:01:17.825296 31498 webserver.cc:533] Webserver started at http://127.29.198.62:37251/ using document root <none> and password file <none>
I20260812 08:01:17.825897 31498 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:17.825958 31498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:17.826211 31498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:17.827828 31498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "d77be81e3021429494cce643d7f7d44e"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-1zqn"
I20260812 08:01:17.828373 31498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "d77be81e3021429494cce643d7f7d44e"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-1zqn"
I20260812 08:01:17.831650 31498 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.003s
I20260812 08:01:17.833889 31514 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.835080 31498 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:17.835259 31498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "d77be81e3021429494cce643d7f7d44e"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-1zqn"
I20260812 08:01:17.835369 31498 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:17.846254 31498 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:17.846941 31498 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:17.847144 31498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:17.854580 31498 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:45605
I20260812 08:01:17.854650 31580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:45605 every 8 connection(s)
I20260812 08:01:17.855638 31498 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:17.858532 31581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:17.859814 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 31498
I20260812 08:01:17.859935 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:17.864399 31581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Bootstrap starting.
I20260812 08:01:17.866890 31581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.867731 31581 log.cc:826] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:17.869397 31581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: No bootstrap required, opened a new log
I20260812 08:01:17.871802 31581 raft_consensus.cc:359] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:17.872033 31581 raft_consensus.cc:385] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.872152 31581 raft_consensus.cc:740] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d77be81e3021429494cce643d7f7d44e, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.872493 31581 consensus_queue.cc:260] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:17.872598 31581 raft_consensus.cc:399] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:17.872634 31581 raft_consensus.cc:493] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:17.872706 31581 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:17.873430 31581 raft_consensus.cc:515] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:17.873703 31581 leader_election.cc:304] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d77be81e3021429494cce643d7f7d44e; no voters: 
I20260812 08:01:17.873974 31581 leader_election.cc:290] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:17.874141 31587 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:17.874401 31587 raft_consensus.cc:697] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 LEADER]: Becoming Leader. State: Replica: d77be81e3021429494cce643d7f7d44e, State: Running, Role: LEADER
I20260812 08:01:17.874679 31587 consensus_queue.cc:237] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:17.875093 31581 sys_catalog.cc:565] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:17.876271 31589 sys_catalog.cc:455] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d77be81e3021429494cce643d7f7d44e. Latest consensus state: current_term: 1 leader_uuid: "d77be81e3021429494cce643d7f7d44e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } } }
I20260812 08:01:17.876251 31588 sys_catalog.cc:455] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d77be81e3021429494cce643d7f7d44e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } } }
I20260812 08:01:17.876397 31589 sys_catalog.cc:458] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:17.876397 31588 sys_catalog.cc:458] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:17.877367 31599 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:17.880585 31599 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:17.885385 31599 catalog_manager.cc:1383] Generated new cluster ID: 74deab29f9254a37a0f056a05bff94d4
I20260812 08:01:17.885452 31599 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:17.897280 31599 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:17.898448 31599 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:17.912223 31599 catalog_manager.cc:6092] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Generated new TSK 0
I20260812 08:01:17.912889 31599 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:17.920677 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
W20260812 08:01:18.034790 31609 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:18.035095 31609 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:18.035188 31609 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:18.039163 31609 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:18.039361 31609 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:18.043921 31609 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--never_fsync=true
--heap_profile_path=/tmp/kudu.31609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:18.045176 31609 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:18.046474 31609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:18.053717 31620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:18.053782 31616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.053885 31609 server_base.cc:1061] running on GCE node
W20260812 08:01:18.053717 31615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.054467 31609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:18.054967 31609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:18.056123 31609 hybrid_clock.cc:648] HybridClock initialized: now 1786521678056110 us; error 28 us; skew 500 ppm
I20260812 08:01:18.057874 31609 webserver.cc:533] Webserver started at http://127.29.198.1:39807/ using document root <none> and password file <none>
I20260812 08:01:18.058401 31609 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:18.058454 31609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:18.058626 31609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:18.060249 31609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "f6cf78c7cbac470c8e146cd3247f18b7"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.060693 31609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "f6cf78c7cbac470c8e146cd3247f18b7"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.063961 31609 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:18.066249 31627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.067302 31609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:18.067425 31609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "f6cf78c7cbac470c8e146cd3247f18b7"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.067523 31609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:18.082785 31609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:18.083686 31609 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:18.083913 31609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:18.084597 31609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:18.085682 31609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:18.085760 31609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.085832 31609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:18.085884 31609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.096432 31609 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:44383
I20260812 08:01:18.096470 31755 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:44383 every 8 connection(s)
I20260812 08:01:18.097435 31609 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:18.098019 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 31609
I20260812 08:01:18.098129 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:18.100734 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
I20260812 08:01:18.107563 31756 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:18.107867 31756 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:18.108500 31756 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:18.110112 31533 ts_manager.cc:194] Registered new tserver with Master: f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1:44383)
I20260812 08:01:18.111263 31533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:36391
W20260812 08:01:18.207595 31759 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:18.207862 31759 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:18.207942 31759 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:18.211301 31759 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:18.211490 31759 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:18.215323 31759 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--never_fsync=true
--heap_profile_path=/tmp/kudu.31759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:18.216537 31759 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:18.217692 31759 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:18.224359 31765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:18.224355 31764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.224473 31759 server_base.cc:1061] running on GCE node
W20260812 08:01:18.224399 31768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.224987 31759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:18.225528 31759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:18.226727 31759 hybrid_clock.cc:648] HybridClock initialized: now 1786521678226714 us; error 34 us; skew 500 ppm
I20260812 08:01:18.228717 31759 webserver.cc:533] Webserver started at http://127.29.198.2:39019/ using document root <none> and password file <none>
I20260812 08:01:18.229298 31759 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:18.229387 31759 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:18.229610 31759 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:18.231249 31759 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "4f44d6e3767c4c37b51427e9eadd69b1"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.231786 31759 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "4f44d6e3767c4c37b51427e9eadd69b1"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.235361 31759 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:18.238049 31776 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.239363 31759 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:01:18.239557 31759 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "4f44d6e3767c4c37b51427e9eadd69b1"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.239660 31759 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:18.268908 31759 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:18.269616 31759 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:18.269783 31759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:18.270354 31759 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:18.271390 31759 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:18.271443 31759 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.271486 31759 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:18.271503 31759 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.282209 31759 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:44805
I20260812 08:01:18.282241 31915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:44805 every 8 connection(s)
I20260812 08:01:18.283233 31759 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:18.287786 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 31759
I20260812 08:01:18.287894 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:18.290482 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
I20260812 08:01:18.293305 31916 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:18.293588 31916 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:18.294246 31916 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:18.295511 31533 ts_manager.cc:194] Registered new tserver with Master: 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805)
I20260812 08:01:18.296213 31533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:49761
W20260812 08:01:18.402130 31919 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:18.402386 31919 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:18.402462 31919 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:18.405791 31919 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:18.405972 31919 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:18.409699 31919 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--never_fsync=true
--heap_profile_path=/tmp/kudu.31919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:18.410894 31919 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:18.412235 31919 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:18.419039 31924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:18.418998 31925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.419341 31919 server_base.cc:1061] running on GCE node
W20260812 08:01:18.418998 31927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.419698 31919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:18.420336 31919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:18.421530 31919 hybrid_clock.cc:648] HybridClock initialized: now 1786521678421512 us; error 29 us; skew 500 ppm
I20260812 08:01:18.423357 31919 webserver.cc:533] Webserver started at http://127.29.198.3:38445/ using document root <none> and password file <none>
I20260812 08:01:18.423959 31919 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:18.424047 31919 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:18.424269 31919 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:18.425784 31919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "a2610ffbab734fbe9fde10ff6d55e1f7"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.426298 31919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "a2610ffbab734fbe9fde10ff6d55e1f7"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.429730 31919 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260812 08:01:18.432238 31933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.433539 31919 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:18.433682 31919 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "a2610ffbab734fbe9fde10ff6d55e1f7"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.433795 31919 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:18.470096 31919 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:18.470813 31919 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:18.471020 31919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:18.471633 31919 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:18.472818 31919 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:18.472892 31919 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.472959 31919 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:18.472991 31919 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.483278 31919 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:37493
I20260812 08:01:18.483310 32072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:37493 every 8 connection(s)
I20260812 08:01:18.484297 31919 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:18.488672 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 31919
I20260812 08:01:18.488799 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:18.490994 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.4:0
--local_ip_for_outbound_sockets=127.29.198.4
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
I20260812 08:01:18.493788 32073 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:18.494045 32073 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:18.494678 32073 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:18.495888 31533 ts_manager.cc:194] Registered new tserver with Master: a2610ffbab734fbe9fde10ff6d55e1f7 (127.29.198.3:37493)
I20260812 08:01:18.496523 31533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:35153
W20260812 08:01:18.598290 32076 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:18.598567 32076 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:18.598683 32076 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:18.602182 32076 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:18.602293 32076 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.4
I20260812 08:01:18.606073 32076 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45605
--never_fsync=true
--heap_profile_path=/tmp/kudu.32076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:18.607163 32076 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:18.608398 32076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:18.615212 32084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:18.615278 32082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:18.615228 32086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:18.615459 32076 server_base.cc:1061] running on GCE node
I20260812 08:01:18.615844 32076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:18.616500 32076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:18.617708 32076 hybrid_clock.cc:648] HybridClock initialized: now 1786521678617676 us; error 43 us; skew 500 ppm
I20260812 08:01:18.619639 32076 webserver.cc:533] Webserver started at http://127.29.198.4:44365/ using document root <none> and password file <none>
I20260812 08:01:18.620559 32076 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:18.620657 32076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:18.620908 32076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:18.622948 32076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data/instance:
uuid: "011de5d65e8844c7bb96bfc7af3918bb"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.623464 32076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance:
uuid: "011de5d65e8844c7bb96bfc7af3918bb"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.627028 32076 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 08:01:18.629379 32096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.630440 32076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:18.630594 32076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal
uuid: "011de5d65e8844c7bb96bfc7af3918bb"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:18.630704 32076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:18.652712 32076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:18.653460 32076 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:18.653674 32076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:18.654297 32076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:18.655465 32076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:18.655560 32076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.655635 32076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:18.655678 32076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:18.665643 32076 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.4:45231
I20260812 08:01:18.665692 32229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.4:45231 every 8 connection(s)
I20260812 08:01:18.666651 32076 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
I20260812 08:01:18.668699 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 32076
I20260812 08:01:18.668815 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance
I20260812 08:01:18.675804 32230 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:18.676112 32230 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:18.676663 32230 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:18.677822 31533 ts_manager.cc:194] Registered new tserver with Master: 011de5d65e8844c7bb96bfc7af3918bb (127.29.198.4:45231)
I20260812 08:01:18.678403 31533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.4:53515
I20260812 08:01:18.683468 30488 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 08:01:18.701937 31533 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40966:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:01:18.719517 32153 tablet_service.cc:1511] Processing CreateTablet for tablet a618edb310b842f2b525c161cdad9c53 (DEFAULT_TABLE table=test-workload [id=5f55a896087a4bea8f38999d78879aeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:18.720530 32153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a618edb310b842f2b525c161cdad9c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:18.720623 31839 tablet_service.cc:1511] Processing CreateTablet for tablet a618edb310b842f2b525c161cdad9c53 (DEFAULT_TABLE table=test-workload [id=5f55a896087a4bea8f38999d78879aeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:18.721647 31839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a618edb310b842f2b525c161cdad9c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:18.722009 31996 tablet_service.cc:1511] Processing CreateTablet for tablet a618edb310b842f2b525c161cdad9c53 (DEFAULT_TABLE table=test-workload [id=5f55a896087a4bea8f38999d78879aeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:18.722936 31996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a618edb310b842f2b525c161cdad9c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:18.725879 32255 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Bootstrap starting.
I20260812 08:01:18.728363 32255 tablet_bootstrap.cc:654] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:18.728456 32257 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: Bootstrap starting.
I20260812 08:01:18.728950 32256 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Bootstrap starting.
I20260812 08:01:18.729331 32255 log.cc:826] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:18.730695 32257 tablet_bootstrap.cc:654] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:18.730933 32255 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: No bootstrap required, opened a new log
I20260812 08:01:18.730990 32256 tablet_bootstrap.cc:654] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:18.731140 32255 ts_tablet_manager.cc:1403] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:18.731554 32257 log.cc:826] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:18.731721 32256 log.cc:826] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:18.733199 32257 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: No bootstrap required, opened a new log
I20260812 08:01:18.733557 32257 ts_tablet_manager.cc:1403] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:18.734483 32256 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: No bootstrap required, opened a new log
I20260812 08:01:18.734375 32255 raft_consensus.cc:359] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.734635 32255 raft_consensus.cc:385] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:18.734673 32256 ts_tablet_manager.cc:1403] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Time spent bootstrapping tablet: real 0.006s	user 0.000s	sys 0.004s
I20260812 08:01:18.734709 32255 raft_consensus.cc:740] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 011de5d65e8844c7bb96bfc7af3918bb, State: Initialized, Role: FOLLOWER
I20260812 08:01:18.735159 32255 consensus_queue.cc:260] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.735879 32230 heartbeater.cc:499] Master 127.29.198.62:45605 was elected leader, sending a full tablet report...
I20260812 08:01:18.736527 32257 raft_consensus.cc:359] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.736727 32257 raft_consensus.cc:385] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:18.736793 32257 raft_consensus.cc:740] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2610ffbab734fbe9fde10ff6d55e1f7, State: Initialized, Role: FOLLOWER
I20260812 08:01:18.737243 32257 consensus_queue.cc:260] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.737560 32255 ts_tablet_manager.cc:1434] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 08:01:18.738127 32257 ts_tablet_manager.cc:1434] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:01:18.738195 32073 heartbeater.cc:499] Master 127.29.198.62:45605 was elected leader, sending a full tablet report...
I20260812 08:01:18.738438 32256 raft_consensus.cc:359] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.738665 32256 raft_consensus.cc:385] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:18.738718 32256 raft_consensus.cc:740] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f44d6e3767c4c37b51427e9eadd69b1, State: Initialized, Role: FOLLOWER
I20260812 08:01:18.739116 32256 consensus_queue.cc:260] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.739786 31916 heartbeater.cc:499] Master 127.29.198.62:45605 was elected leader, sending a full tablet report...
I20260812 08:01:18.740523 32256 ts_tablet_manager.cc:1434] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
W20260812 08:01:18.784440 31917 tablet.cc:2406] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:18.850728 32262 raft_consensus.cc:493] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:18.850993 32262 raft_consensus.cc:515] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.852219 32262 leader_election.cc:290] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2610ffbab734fbe9fde10ff6d55e1f7 (127.29.198.3:37493), 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805)
I20260812 08:01:18.857218 32018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a618edb310b842f2b525c161cdad9c53" candidate_uuid: "011de5d65e8844c7bb96bfc7af3918bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" is_pre_election: true
I20260812 08:01:18.857538 32018 raft_consensus.cc:2468] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 011de5d65e8844c7bb96bfc7af3918bb in term 0.
I20260812 08:01:18.857590 31862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a618edb310b842f2b525c161cdad9c53" candidate_uuid: "011de5d65e8844c7bb96bfc7af3918bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" is_pre_election: true
I20260812 08:01:18.857849 31862 raft_consensus.cc:2468] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 011de5d65e8844c7bb96bfc7af3918bb in term 0.
I20260812 08:01:18.858112 32100 leader_election.cc:304] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 011de5d65e8844c7bb96bfc7af3918bb, a2610ffbab734fbe9fde10ff6d55e1f7; no voters: 
I20260812 08:01:18.858392 32262 raft_consensus.cc:2804] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:18.858472 32262 raft_consensus.cc:493] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:18.858515 32262 raft_consensus.cc:3060] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:18.859519 32262 raft_consensus.cc:515] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.859949 32262 leader_election.cc:290] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [CANDIDATE]: Term 1 election: Requested vote from peers a2610ffbab734fbe9fde10ff6d55e1f7 (127.29.198.3:37493), 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805)
I20260812 08:01:18.860473 31862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a618edb310b842f2b525c161cdad9c53" candidate_uuid: "011de5d65e8844c7bb96bfc7af3918bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f44d6e3767c4c37b51427e9eadd69b1"
I20260812 08:01:18.860476 32018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a618edb310b842f2b525c161cdad9c53" candidate_uuid: "011de5d65e8844c7bb96bfc7af3918bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7"
I20260812 08:01:18.860607 31862 raft_consensus.cc:3060] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:18.860644 32018 raft_consensus.cc:3060] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:18.862300 32018 raft_consensus.cc:2468] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 011de5d65e8844c7bb96bfc7af3918bb in term 1.
I20260812 08:01:18.862300 31862 raft_consensus.cc:2468] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 011de5d65e8844c7bb96bfc7af3918bb in term 1.
I20260812 08:01:18.862668 32100 leader_election.cc:304] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 011de5d65e8844c7bb96bfc7af3918bb, a2610ffbab734fbe9fde10ff6d55e1f7; no voters: 
I20260812 08:01:18.862982 32262 raft_consensus.cc:2804] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:18.863226 32262 raft_consensus.cc:697] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 1 LEADER]: Becoming Leader. State: Replica: 011de5d65e8844c7bb96bfc7af3918bb, State: Running, Role: LEADER
I20260812 08:01:18.863777 32262 consensus_queue.cc:237] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } }
I20260812 08:01:18.867419 31532 catalog_manager.cc:5719] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 011de5d65e8844c7bb96bfc7af3918bb (127.29.198.4). New cstate: current_term: 1 leader_uuid: "011de5d65e8844c7bb96bfc7af3918bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } health_report { overall_health: UNKNOWN } } }
W20260812 08:01:18.917583 32231 tablet.cc:2406] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:18.918334 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 31759
W20260812 08:01:18.985395 32074 tablet.cc:2406] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:19.113350 31756 heartbeater.cc:499] Master 127.29.198.62:45605 was elected leader, sending a full tablet report...
W20260812 08:01:19.478698 32100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.2:44805: connect: Connection refused (error 111)
W20260812 08:01:19.479846 32100 consensus_peers.cc:597] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb -> Peer 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805): Couldn't send request to peer 4f44d6e3767c4c37b51427e9eadd69b1. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:19.481055 32273 consensus_queue.cc:1048] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:22.086215 32100 consensus_peers.cc:597] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb -> Peer 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805): Couldn't send request to peer 4f44d6e3767c4c37b51427e9eadd69b1. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 08:01:24.061782 32291 consensus_queue.cc:579] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Leader has been unable to successfully communicate with peer 4f44d6e3767c4c37b51427e9eadd69b1 for more than 5 seconds (5.197s)
I20260812 08:01:24.066291 32176 consensus_queue.cc:237] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } }
I20260812 08:01:24.068656 32018 raft_consensus.cc:1275] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Refusing update from remote peer 011de5d65e8844c7bb96bfc7af3918bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:24.069344 32299 consensus_queue.cc:1048] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 08:01:24.069846 32100 consensus_peers.cc:597] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb -> Peer 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805): Couldn't send request to peer 4f44d6e3767c4c37b51427e9eadd69b1. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:24.071933 32298 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } } }
I20260812 08:01:24.072727 32018 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } } }
W20260812 08:01:24.073279 32100 consensus_peers.cc:597] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb -> Peer f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1:44383): Couldn't send request to peer f6cf78c7cbac470c8e146cd3247f18b7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a618edb310b842f2b525c161cdad9c53. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:24.074534 31518 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a618edb310b842f2b525c161cdad9c53 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 08:01:24.075340 31533 catalog_manager.cc:5719] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb reported cstate change: config changed from index -1 to 2, NON_VOTER f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) added. New cstate: current_term: 1 leader_uuid: "011de5d65e8844c7bb96bfc7af3918bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 08:01:24.531821 32100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.2:44805: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260812 08:01:24.684738 32313 ts_tablet_manager.cc:933] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Initiating tablet copy from peer 011de5d65e8844c7bb96bfc7af3918bb (127.29.198.4:45231)
I20260812 08:01:24.685322 32313 tablet_copy_client.cc:323] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: tablet copy: Beginning tablet copy session from remote peer at address 127.29.198.4:45231
I20260812 08:01:24.689663 32199 tablet_copy_service.cc:140] P 011de5d65e8844c7bb96bfc7af3918bb: Received BeginTabletCopySession request for tablet a618edb310b842f2b525c161cdad9c53 from peer f6cf78c7cbac470c8e146cd3247f18b7 ({username='slave'} at 127.29.198.1:53679)
I20260812 08:01:24.689810 32199 tablet_copy_service.cc:161] P 011de5d65e8844c7bb96bfc7af3918bb: Beginning new tablet copy session on tablet a618edb310b842f2b525c161cdad9c53 from peer f6cf78c7cbac470c8e146cd3247f18b7 at {username='slave'} at 127.29.198.1:53679: session id = f6cf78c7cbac470c8e146cd3247f18b7-a618edb310b842f2b525c161cdad9c53
I20260812 08:01:24.690987 32199 tablet_copy_source_session.cc:215] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:01:24.694577 32313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a618edb310b842f2b525c161cdad9c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:24.699379 32313 tablet_copy_client.cc:806] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: tablet copy: Starting download of 0 data blocks...
I20260812 08:01:24.699605 32313 tablet_copy_client.cc:670] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: tablet copy: Starting download of 1 WAL segments...
I20260812 08:01:24.701478 32313 tablet_copy_client.cc:538] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:01:24.702937 32313 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Bootstrap starting.
I20260812 08:01:24.707649 32313 log.cc:826] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:24.710098 32313 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:24.710382 32313 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Bootstrap complete.
I20260812 08:01:24.710675 32313 ts_tablet_manager.cc:1403] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Time spent bootstrapping tablet: real 0.008s	user 0.007s	sys 0.000s
I20260812 08:01:24.713059 32313 raft_consensus.cc:359] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } }
I20260812 08:01:24.713294 32313 raft_consensus.cc:740] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f6cf78c7cbac470c8e146cd3247f18b7, State: Initialized, Role: LEARNER
I20260812 08:01:24.713620 32313 consensus_queue.cc:260] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "4f44d6e3767c4c37b51427e9eadd69b1" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44805 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } }
I20260812 08:01:24.714375 32313 ts_tablet_manager.cc:1434] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:01:24.715287 32199 tablet_copy_service.cc:342] P 011de5d65e8844c7bb96bfc7af3918bb: Request end of tablet copy session f6cf78c7cbac470c8e146cd3247f18b7-a618edb310b842f2b525c161cdad9c53 received from {username='slave'} at 127.29.198.1:53679
I20260812 08:01:24.715413 32199 tablet_copy_service.cc:434] P 011de5d65e8844c7bb96bfc7af3918bb: ending tablet copy session f6cf78c7cbac470c8e146cd3247f18b7-a618edb310b842f2b525c161cdad9c53 on tablet a618edb310b842f2b525c161cdad9c53 with peer f6cf78c7cbac470c8e146cd3247f18b7
I20260812 08:01:24.717717 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:44805
--local_ip_for_outbound_sockets=127.29.198.2
--tserver_master_addrs=127.29.198.62:45605
--webserver_port=39019
--webserver_interface=127.29.198.2
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5 with env {}
W20260812 08:01:24.825495 32319 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:24.825706 32319 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:24.825753 32319 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:24.829236 32319 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:24.829377 32319 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:24.833294 32319 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:44805
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=39019
--tserver_master_addrs=127.29.198.62:45605
--never_fsync=true
--heap_profile_path=/tmp/kudu.32319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:24.834429 32319 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:24.835696 32319 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:24.842681 32325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:24.842689 32324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:24.842860 32319 server_base.cc:1061] running on GCE node
W20260812 08:01:24.842706 32327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:24.843402 32319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:24.843909 32319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:24.845064 32319 hybrid_clock.cc:648] HybridClock initialized: now 1786521684845048 us; error 33 us; skew 500 ppm
I20260812 08:01:24.847066 32319 webserver.cc:533] Webserver started at http://127.29.198.2:39019/ using document root <none> and password file <none>
I20260812 08:01:24.847661 32319 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:24.847756 32319 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:24.851266 32319 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:24.853457 32333 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:24.854756 32319 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:24.854897 32319 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "4f44d6e3767c4c37b51427e9eadd69b1"
format_stamp: "Formatted at 2026-08-12 08:01:18 on dist-test-slave-1zqn"
I20260812 08:01:24.855369 32319 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:24.888870 32319 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:24.889601 32319 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:24.889830 32319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:24.890468 32319 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:24.891795 32341 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:01:24.895434 32319 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:01:24.895514 32319 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:01:24.895625 32319 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:01:24.897171 32319 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:01:24.897240 32319 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:24.897588 32341 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Bootstrap starting.
I20260812 08:01:24.910043 32319 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:44805
I20260812 08:01:24.910107 32468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:44805 every 8 connection(s)
I20260812 08:01:24.911113 32319 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:24.912701 32341 log.cc:826] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:24.914310 32341 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:24.914683 32341 tablet_bootstrap.cc:492] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Bootstrap complete.
I20260812 08:01:24.915087 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 32319
I20260812 08:01:24.916324 32341 ts_tablet_manager.cc:1403] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.003s
E20260812 08:01:24.919335 32341 ts_tablet_manager.cc:1446] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Tablet failed to start: Corruption: Unable to start RaftConsensus: The last op in the WAL with id 0.0 has a term (0) that is greater than the latest recorded term, which is -1
I20260812 08:01:24.919478 32341 ts_tablet_manager.cc:1434] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:24.919596 32341 tablet_replica.cc:333] stopping tablet replica
I20260812 08:01:24.919768 32341 raft_consensus.cc:2243] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term -1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:01:24.920256 32341 raft_consensus.cc:2272] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1 [term -1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:01:24.925447 32470 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:24.925719 32470 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:24.926242 32470 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:24.926951 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 31498
W20260812 08:01:24.938849 32336 connection.cc:573] client connection to 127.29.198.62:45605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:24.939445 32470 heartbeater.cc:646] Failed to heartbeat to 127.29.198.62:45605 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:01:24.939755 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:45605
--webserver_interface=127.29.198.62
--webserver_port=37251
--builtin_ntp_servers=127.29.198.20:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:45605
--master_tombstone_evicted_tablet_replicas=false
--master_tombstone_evicted_tablet_replicas=true with env {}
W20260812 08:01:24.941511 32470 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 08:01:25.050629 32478 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:25.050849 32478 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:25.050891 32478 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:25.054199 32478 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:25.054257 32478 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:25.054278 32478 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:25.054296 32478 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:25.058166 32478 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:45605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:45605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=37251
--never_fsync=true
--heap_profile_path=/tmp/kudu.32478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:25.059357 32478 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:25.060609 32478 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:25.066044 32485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:25.065968 32483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:25.065965 32487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:25.066171 32478 server_base.cc:1061] running on GCE node
I20260812 08:01:25.066733 32478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:25.067605 32478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:25.068792 32478 hybrid_clock.cc:648] HybridClock initialized: now 1786521685068777 us; error 31 us; skew 500 ppm
I20260812 08:01:25.070518 32478 webserver.cc:533] Webserver started at http://127.29.198.62:37251/ using document root <none> and password file <none>
I20260812 08:01:25.071126 32478 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:25.071228 32478 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:25.074766 32478 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:25.076881 32495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:25.077888 32478 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:01:25.078023 32478 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "d77be81e3021429494cce643d7f7d44e"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-1zqn"
I20260812 08:01:25.078420 32478 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 08:01:25.081102 32073 heartbeater.cc:646] Failed to heartbeat to 127.29.198.62:45605 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.198.62:45605: connect: Connection refused (error 111)
W20260812 08:01:25.081429 32230 heartbeater.cc:646] Failed to heartbeat to 127.29.198.62:45605 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.198.62:45605: connect: Connection refused (error 111)
I20260812 08:01:25.100504 32100 consensus_queue.cc:579] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: The tablet replica hosted on peer 4f44d6e3767c4c37b51427e9eadd69b1 has failed
I20260812 08:01:25.102981 32478 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:25.103709 32478 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:25.103922 32478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:25.112804 32478 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:45605
I20260812 08:01:25.112780 32558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:45605 every 8 connection(s)
I20260812 08:01:25.113940 32478 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:25.116773 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 32478
I20260812 08:01:25.118343 32559 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:01:25.119807 32559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Bootstrap starting.
I20260812 08:01:25.135628 32559 log.cc:826] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:25.143958 32559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=3 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:25.144368 32559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Bootstrap complete.
I20260812 08:01:25.148276 32559 raft_consensus.cc:359] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:25.148602 32559 raft_consensus.cc:740] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d77be81e3021429494cce643d7f7d44e, State: Initialized, Role: FOLLOWER
I20260812 08:01:25.149130 32559 consensus_queue.cc:260] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:25.149246 32559 raft_consensus.cc:399] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:25.149293 32559 raft_consensus.cc:493] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:25.149375 32559 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:25.150832 32559 raft_consensus.cc:515] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:25.151118 32559 leader_election.cc:304] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d77be81e3021429494cce643d7f7d44e; no voters: 
I20260812 08:01:25.151386 32559 leader_election.cc:290] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 08:01:25.151561 32562 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:01:25.151867 32562 raft_consensus.cc:697] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [term 2 LEADER]: Becoming Leader. State: Replica: d77be81e3021429494cce643d7f7d44e, State: Running, Role: LEADER
I20260812 08:01:25.152302 32562 consensus_queue.cc:237] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } }
I20260812 08:01:25.152680 32559 sys_catalog.cc:565] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:25.153849 32564 sys_catalog.cc:455] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d77be81e3021429494cce643d7f7d44e. Latest consensus state: current_term: 2 leader_uuid: "d77be81e3021429494cce643d7f7d44e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } } }
I20260812 08:01:25.153977 32564 sys_catalog.cc:458] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:25.154217 32563 sys_catalog.cc:455] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d77be81e3021429494cce643d7f7d44e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d77be81e3021429494cce643d7f7d44e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45605 } } }
I20260812 08:01:25.154295 32563 sys_catalog.cc:458] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:25.154572 32572 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:25.158280 32572 catalog_manager.cc:679] Loaded metadata for table test-workload [id=5f55a896087a4bea8f38999d78879aeb]
I20260812 08:01:25.159756 32572 tablet_loader.cc:96] loaded metadata for tablet a618edb310b842f2b525c161cdad9c53 (table test-workload [id=5f55a896087a4bea8f38999d78879aeb])
I20260812 08:01:25.159947 32572 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:25.160780 32572 catalog_manager.cc:1295] Loaded cluster ID: 74deab29f9254a37a0f056a05bff94d4
I20260812 08:01:25.160858 32572 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:25.162743 32572 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:25.163379 32572 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d77be81e3021429494cce643d7f7d44e: Loaded TSK: 0
I20260812 08:01:25.164314 32572 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:25.277002 31705 raft_consensus.cc:1217] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 08:01:25.284775 32230 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:25.284765 32516 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" instance_seqno: 1786521678093404) as {username='slave'} at 127.29.198.1:34499; Asking this server to re-register.
I20260812 08:01:25.285426 31756 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:25.285632 31756 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:25.285912 32516 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" instance_seqno: 1786521678662958) as {username='slave'} at 127.29.198.4:58169; Asking this server to re-register.
I20260812 08:01:25.286381 32230 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:25.286562 32230 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:25.286799 32516 ts_manager.cc:194] Registered new tserver with Master: f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1:44383)
I20260812 08:01:25.287352 32517 ts_manager.cc:194] Registered new tserver with Master: 011de5d65e8844c7bb96bfc7af3918bb (127.29.198.4:45231)
I20260812 08:01:25.295287 32176 consensus_queue.cc:237] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } }
I20260812 08:01:25.297015 31705 raft_consensus.cc:1275] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 LEARNER]: Refusing update from remote peer 011de5d65e8844c7bb96bfc7af3918bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:01:25.297073 32018 raft_consensus.cc:1275] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Refusing update from remote peer 011de5d65e8844c7bb96bfc7af3918bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:01:25.297554 32582 consensus_queue.cc:1048] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:01:25.297689 32299 consensus_queue.cc:1048] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:01:25.300691 32504 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } } }
I20260812 08:01:25.302148 32504 raft_consensus.cc:1064] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb: attempting to promote NON_VOTER f6cf78c7cbac470c8e146cd3247f18b7 to VOTER
I20260812 08:01:25.302513 32504 consensus_queue.cc:237] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: false } }
I20260812 08:01:25.303797 32500 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet a618edb310b842f2b525c161cdad9c53 with cas_config_opid_index 2: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 08:01:25.304230 31704 raft_consensus.cc:1275] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 LEARNER]: Refusing update from remote peer 011de5d65e8844c7bb96bfc7af3918bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 08:01:25.303335 32517 catalog_manager.cc:5719] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb reported cstate change: config changed from index 2 to 3, VOTER 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2) evicted. New cstate: current_term: 1 leader_uuid: "011de5d65e8844c7bb96bfc7af3918bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260812 08:01:25.304514 32018 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } } }
I20260812 08:01:25.304672 31705 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 LEARNER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: true } } }
I20260812 08:01:25.306156 32017 raft_consensus.cc:1275] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Refusing update from remote peer 011de5d65e8844c7bb96bfc7af3918bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 08:01:25.307437 32299 consensus_queue.cc:1048] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:01:25.307788 32299 consensus_queue.cc:1048] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:01:25.310331 32299 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: false } } }
I20260812 08:01:25.312536 31705 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P f6cf78c7cbac470c8e146cd3247f18b7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: false } } }
W20260812 08:01:25.313103 32517 catalog_manager.cc:5911] Failed to send DeleteTablet RPC for tablet a618edb310b842f2b525c161cdad9c53 on TS 4f44d6e3767c4c37b51427e9eadd69b1: Not found: failed to reset TS proxy: Could not find TS for UUID 4f44d6e3767c4c37b51427e9eadd69b1
I20260812 08:01:25.314055 32073 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:25.315303 32517 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" instance_seqno: 1786521678480456) as {username='slave'} at 127.29.198.3:47775; Asking this server to re-register.
I20260812 08:01:25.315919 32073 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:25.316146 32073 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:25.316596 32516 catalog_manager.cc:5719] T a618edb310b842f2b525c161cdad9c53 P 011de5d65e8844c7bb96bfc7af3918bb reported cstate change: config changed from index 3 to 4, f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "011de5d65e8844c7bb96bfc7af3918bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 08:01:25.317077 32515 ts_manager.cc:194] Registered new tserver with Master: a2610ffbab734fbe9fde10ff6d55e1f7 (127.29.198.3:37493)
I20260812 08:01:25.318578 32017 raft_consensus.cc:2955] T a618edb310b842f2b525c161cdad9c53 P a2610ffbab734fbe9fde10ff6d55e1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, f6cf78c7cbac470c8e146cd3247f18b7 (127.29.198.1) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "011de5d65e8844c7bb96bfc7af3918bb" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45231 } } peers { permanent_uuid: "a2610ffbab734fbe9fde10ff6d55e1f7" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 37493 } } peers { permanent_uuid: "f6cf78c7cbac470c8e146cd3247f18b7" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44383 } attrs { promote: false } } }
W20260812 08:01:25.366578 32499 catalog_manager.cc:4832] Async tablet task DeleteTablet RPC for tablet a618edb310b842f2b525c161cdad9c53 on TS 4f44d6e3767c4c37b51427e9eadd69b1 failed: Not found: failed to reset TS proxy: Could not find TS for UUID 4f44d6e3767c4c37b51427e9eadd69b1
I20260812 08:01:25.947453 32470 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45605
I20260812 08:01:25.947611 32470 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:25.947856 32470 heartbeater.cc:507] Master 127.29.198.62:45605 requested a full tablet report, sending...
I20260812 08:01:25.948856 32515 ts_manager.cc:194] Registered new tserver with Master: 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805)
I20260812 08:01:25.950060 32515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:43339
I20260812 08:01:25.981981 32390 tablet_service.cc:1558] Processing DeleteTablet for tablet a618edb310b842f2b525c161cdad9c53 with delete_type TABLET_DATA_TOMBSTONED (TS 4f44d6e3767c4c37b51427e9eadd69b1 not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:34758
I20260812 08:01:25.982581 32601 ts_tablet_manager.cc:1916] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:01:25.986013 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 31609
I20260812 08:01:25.992373 32601 ts_tablet_manager.cc:1929] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260812 08:01:25.992506 32601 log.cc:1199] T a618edb310b842f2b525c161cdad9c53 P 4f44d6e3767c4c37b51427e9eadd69b1: Deleting WAL directory at /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal/wals/a618edb310b842f2b525c161cdad9c53
I20260812 08:01:25.993240 32503 catalog_manager.cc:5050] TS 4f44d6e3767c4c37b51427e9eadd69b1 (127.29.198.2:44805): tablet a618edb310b842f2b525c161cdad9c53 (table test-workload [id=5f55a896087a4bea8f38999d78879aeb]) successfully deleted
I20260812 08:01:26.000167 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 32319
I20260812 08:01:26.010543 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 31919
I20260812 08:01:26.023043 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 32076
I20260812 08:01:26.033447 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 32478
2026-08-12T08:01:26Z chronyd exiting
[       OK ] TabletReplacementITest.TestMasterTombstoneFailedEvictedReplicaOnReport (8374 ms)
[ RUN      ] TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport
2026-08-12T08:01:26Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:26Z Disabled control of system clock
I20260812 08:01:26.069376 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:45715
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:45509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:45715
--master_add_server_when_underreplicated=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:01:26.180403 32608 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:26.180639 32608 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:26.180678 32608 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:26.183872 32608 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:26.183933 32608 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:26.183955 32608 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:26.183976 32608 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:26.187947 32608 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:45509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:45715
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:45715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.32608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:26.189164 32608 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:26.190382 32608 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:26.196513 32615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.196547 32618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.196658 32616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:26.196902 32608 server_base.cc:1061] running on GCE node
I20260812 08:01:26.197350 32608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:26.198240 32608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:26.199400 32608 hybrid_clock.cc:648] HybridClock initialized: now 1786521686199386 us; error 33 us; skew 500 ppm
I20260812 08:01:26.201299 32608 webserver.cc:533] Webserver started at http://127.29.198.62:43287/ using document root <none> and password file <none>
I20260812 08:01:26.201954 32608 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:26.202011 32608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:26.202232 32608 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:26.203783 32608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "22f28a8ace5a43a39e541d199bbe497f"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.204296 32608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "22f28a8ace5a43a39e541d199bbe497f"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.207675 32608 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:26.209879 32624 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.210932 32608 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:26.211086 32608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "22f28a8ace5a43a39e541d199bbe497f"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.211192 32608 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:26.227989 32608 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:26.229012 32608 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:26.229231 32608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:26.237776 32608 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:45715
I20260812 08:01:26.237819 32683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:45715 every 8 connection(s)
I20260812 08:01:26.238916 32608 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:26.242630 32684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:26.245430 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 32608
I20260812 08:01:26.245555 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:26.250264 32684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f: Bootstrap starting.
I20260812 08:01:26.252737 32684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:26.253523 32684 log.cc:826] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:26.255329 32684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f: No bootstrap required, opened a new log
I20260812 08:01:26.258082 32684 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f28a8ace5a43a39e541d199bbe497f" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45715 } }
I20260812 08:01:26.258316 32684 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:26.258419 32684 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f28a8ace5a43a39e541d199bbe497f, State: Initialized, Role: FOLLOWER
I20260812 08:01:26.258951 32684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f28a8ace5a43a39e541d199bbe497f" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45715 } }
I20260812 08:01:26.259141 32684 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:26.259223 32684 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:26.259343 32684 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:26.260550 32684 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f28a8ace5a43a39e541d199bbe497f" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45715 } }
I20260812 08:01:26.260972 32684 leader_election.cc:304] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22f28a8ace5a43a39e541d199bbe497f; no voters: 
I20260812 08:01:26.261343 32684 leader_election.cc:290] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:26.261469 32690 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:26.261689 32690 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [term 1 LEADER]: Becoming Leader. State: Replica: 22f28a8ace5a43a39e541d199bbe497f, State: Running, Role: LEADER
I20260812 08:01:26.261976 32690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f28a8ace5a43a39e541d199bbe497f" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45715 } }
I20260812 08:01:26.262769 32684 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:26.263222 32690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22f28a8ace5a43a39e541d199bbe497f. Latest consensus state: current_term: 1 leader_uuid: "22f28a8ace5a43a39e541d199bbe497f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f28a8ace5a43a39e541d199bbe497f" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45715 } } }
I20260812 08:01:26.263337 32690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:26.264490 32691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22f28a8ace5a43a39e541d199bbe497f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22f28a8ace5a43a39e541d199bbe497f" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 45715 } } }
I20260812 08:01:26.264743 32691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:26.265918 32694 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:26.269658 32694 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:26.274634 32694 catalog_manager.cc:1383] Generated new cluster ID: 011c4d1962b54f10b26cdb45d2cf1d71
I20260812 08:01:26.274701 32694 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:26.287674 32694 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:26.288673 32694 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:26.299830 32694 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 22f28a8ace5a43a39e541d199bbe497f: Generated new TSK 0
I20260812 08:01:26.300474 32694 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:26.312925 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45715
--builtin_ntp_servers=127.29.198.20:45509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:26.435308 32712 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:26.435606 32712 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:26.435657 32712 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:26.435731 32712 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:26.439189 32712 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:26.439373 32712 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:26.443361 32712 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:45509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45715
--never_fsync=true
--heap_profile_path=/tmp/kudu.32712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:26.444684 32712 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:26.445849 32712 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:26.453090 32718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.453125 32717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.453193 32720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:26.453907 32712 server_base.cc:1061] running on GCE node
I20260812 08:01:26.454365 32712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:26.455065 32712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:26.456262 32712 hybrid_clock.cc:648] HybridClock initialized: now 1786521686456242 us; error 39 us; skew 500 ppm
I20260812 08:01:26.458381 32712 webserver.cc:533] Webserver started at http://127.29.198.1:41649/ using document root <none> and password file <none>
I20260812 08:01:26.459034 32712 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:26.459132 32712 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:26.459367 32712 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:26.461150 32712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "608afee16fb54cb294e2e5a5df78c0bc"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.461669 32712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "608afee16fb54cb294e2e5a5df78c0bc"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.465301 32712 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:26.467532 32727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.468623 32712 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:26.468761 32712 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "608afee16fb54cb294e2e5a5df78c0bc"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.468868 32712 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:26.481309 32712 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:26.481977 32712 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:26.482190 32712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:26.482766 32712 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:26.483832 32712 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:26.483906 32712 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.483975 32712 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:26.484009 32712 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.494124 32712 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:41237
I20260812 08:01:26.494161   382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:41237 every 8 connection(s)
I20260812 08:01:26.495141 32712 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:26.500870 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 32712
I20260812 08:01:26.501060 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:26.503590 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45715
--builtin_ntp_servers=127.29.198.20:45509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:26.504868   384 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45715
I20260812 08:01:26.505175   384 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:26.505734   384 heartbeater.cc:507] Master 127.29.198.62:45715 requested a full tablet report, sending...
I20260812 08:01:26.507377 32644 ts_manager.cc:194] Registered new tserver with Master: 608afee16fb54cb294e2e5a5df78c0bc (127.29.198.1:41237)
I20260812 08:01:26.509171 32644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:59397
W20260812 08:01:26.612534   387 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:26.612773   387 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:26.612797   387 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:26.612838   387 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:26.616230   387 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:26.616343   387 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:26.620229   387 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:45509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45715
--never_fsync=true
--heap_profile_path=/tmp/kudu.387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:26.621343   387 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:26.622524   387 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:26.629264   387 server_base.cc:1061] running on GCE node
W20260812 08:01:26.629314   393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.629207   392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.629207   395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:26.629807   387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:26.630496   387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:26.631698   387 hybrid_clock.cc:648] HybridClock initialized: now 1786521686631680 us; error 34 us; skew 500 ppm
I20260812 08:01:26.633637   387 webserver.cc:533] Webserver started at http://127.29.198.2:39453/ using document root <none> and password file <none>
I20260812 08:01:26.634235   387 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:26.634325   387 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:26.634558   387 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:26.636245   387 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "2d56ff6354484c53adc704d2bdfd365a"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.636758   387 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "2d56ff6354484c53adc704d2bdfd365a"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.640312   387 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:26.642614   403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.643713   387 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:26.643865   387 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "2d56ff6354484c53adc704d2bdfd365a"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.643980   387 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:26.655956   387 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:26.656726   387 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:26.656939   387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:26.657574   387 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:26.658666   387 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:26.658746   387 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.658814   387 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:26.658890   387 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.669569   387 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:37833
I20260812 08:01:26.669662   537 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:37833 every 8 connection(s)
I20260812 08:01:26.670744   387 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:26.679668   538 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45715
I20260812 08:01:26.680037   538 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:26.680723   538 heartbeater.cc:507] Master 127.29.198.62:45715 requested a full tablet report, sending...
I20260812 08:01:26.681008 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 387
I20260812 08:01:26.681129 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:26.681949 32644 ts_manager.cc:194] Registered new tserver with Master: 2d56ff6354484c53adc704d2bdfd365a (127.29.198.2:37833)
I20260812 08:01:26.682536 32644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:44683
I20260812 08:01:26.683789 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45715
--builtin_ntp_servers=127.29.198.20:45509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:26.792024   541 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:26.792330   541 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:26.792377   541 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:26.792466   541 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:26.795874   541 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:26.796043   541 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:26.800191   541 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:45509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:45715
--never_fsync=true
--heap_profile_path=/tmp/kudu.541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:26.801375   541 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:26.802585   541 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:26.809316   546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:26.809434   550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:26.809537   541 server_base.cc:1061] running on GCE node
W20260812 08:01:26.809554   547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:26.810015   541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:26.810544   541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:26.811699   541 hybrid_clock.cc:648] HybridClock initialized: now 1786521686811676 us; error 35 us; skew 500 ppm
I20260812 08:01:26.813594   541 webserver.cc:533] Webserver started at http://127.29.198.3:40563/ using document root <none> and password file <none>
I20260812 08:01:26.814181   541 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:26.814239   541 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:26.814481   541 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:26.816224   541 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "0d7a24334ff1431782410b5038389588"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.816733   541 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "0d7a24334ff1431782410b5038389588"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.820261   541 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:26.822449   556 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.823474   541 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:26.823608   541 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "0d7a24334ff1431782410b5038389588"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:26.823734   541 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:26.837178   541 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:26.837888   541 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:26.838110   541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:26.838747   541 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:26.839823   541 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:26.839897   541 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.839969   541 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:26.840001   541 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:26.850011   541 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:43495
I20260812 08:01:26.850104   692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:43495 every 8 connection(s)
I20260812 08:01:26.851101   541 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:26.860500   693 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45715
I20260812 08:01:26.860697 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 541
I20260812 08:01:26.860797   693 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:26.860793 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:26.861361   693 heartbeater.cc:507] Master 127.29.198.62:45715 requested a full tablet report, sending...
I20260812 08:01:26.862632 32643 ts_manager.cc:194] Registered new tserver with Master: 0d7a24334ff1431782410b5038389588 (127.29.198.3:43495)
I20260812 08:01:26.863248 32643 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:50065
I20260812 08:01:26.875147 30488 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:26.893361 32643 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38832:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:26.894448 32643 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:26.912169   616 tablet_service.cc:1511] Processing CreateTablet for tablet f44fe50296064244a05be153caaf5547 (DEFAULT_TABLE table=test-workload [id=58a2f61b121948f588cff803ad67f578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:26.912180   462 tablet_service.cc:1511] Processing CreateTablet for tablet f44fe50296064244a05be153caaf5547 (DEFAULT_TABLE table=test-workload [id=58a2f61b121948f588cff803ad67f578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:26.912180   313 tablet_service.cc:1511] Processing CreateTablet for tablet f44fe50296064244a05be153caaf5547 (DEFAULT_TABLE table=test-workload [id=58a2f61b121948f588cff803ad67f578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:26.913108   616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44fe50296064244a05be153caaf5547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:26.913122   462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44fe50296064244a05be153caaf5547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:26.913122   313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44fe50296064244a05be153caaf5547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:26.918246   726 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Bootstrap starting.
I20260812 08:01:26.919052   728 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: Bootstrap starting.
I20260812 08:01:26.920370   727 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: Bootstrap starting.
I20260812 08:01:26.921026   726 tablet_bootstrap.cc:654] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:26.921204   728 tablet_bootstrap.cc:654] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:26.921875   726 log.cc:826] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:26.922021   728 log.cc:826] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:26.922510   727 tablet_bootstrap.cc:654] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:26.923194   727 log.cc:826] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:26.923574   726 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: No bootstrap required, opened a new log
I20260812 08:01:26.923774   726 ts_tablet_manager.cc:1403] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:26.924999   727 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: No bootstrap required, opened a new log
I20260812 08:01:26.925282   727 ts_tablet_manager.cc:1403] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:26.925544   728 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: No bootstrap required, opened a new log
I20260812 08:01:26.925738   728 ts_tablet_manager.cc:1403] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 08:01:26.927387   726 raft_consensus.cc:359] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.927635   726 raft_consensus.cc:740] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7a24334ff1431782410b5038389588, State: Initialized, Role: FOLLOWER
I20260812 08:01:26.927968   726 consensus_queue.cc:260] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.928141   727 raft_consensus.cc:359] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.928359   727 raft_consensus.cc:740] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608afee16fb54cb294e2e5a5df78c0bc, State: Initialized, Role: FOLLOWER
I20260812 08:01:26.928624   727 consensus_queue.cc:260] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.928966   726 ts_tablet_manager.cc:1434] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:01:26.929018   728 raft_consensus.cc:359] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.929219   728 raft_consensus.cc:740] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d56ff6354484c53adc704d2bdfd365a, State: Initialized, Role: FOLLOWER
I20260812 08:01:26.929347   693 heartbeater.cc:499] Master 127.29.198.62:45715 was elected leader, sending a full tablet report...
I20260812 08:01:26.929411   384 heartbeater.cc:499] Master 127.29.198.62:45715 was elected leader, sending a full tablet report...
I20260812 08:01:26.929493   727 ts_tablet_manager.cc:1434] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:01:26.929473   728 consensus_queue.cc:260] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.930109   538 heartbeater.cc:499] Master 127.29.198.62:45715 was elected leader, sending a full tablet report...
I20260812 08:01:26.930281   728 ts_tablet_manager.cc:1434] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 08:01:26.961483   333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44fe50296064244a05be153caaf5547"
dest_uuid: "608afee16fb54cb294e2e5a5df78c0bc"
 from {username='slave'} at 127.0.0.1:34162
I20260812 08:01:26.961760   333 raft_consensus.cc:493] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:26.961905   333 raft_consensus.cc:3060] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:26.962915   333 raft_consensus.cc:515] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.964159   333 leader_election.cc:290] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [CANDIDATE]: Term 1 election: Requested vote from peers 0d7a24334ff1431782410b5038389588 (127.29.198.3:43495), 2d56ff6354484c53adc704d2bdfd365a (127.29.198.2:37833)
I20260812 08:01:26.967307 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:01:26.968860   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44fe50296064244a05be153caaf5547" candidate_uuid: "608afee16fb54cb294e2e5a5df78c0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0d7a24334ff1431782410b5038389588"
I20260812 08:01:26.969007   486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44fe50296064244a05be153caaf5547" candidate_uuid: "608afee16fb54cb294e2e5a5df78c0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2d56ff6354484c53adc704d2bdfd365a"
I20260812 08:01:26.969120   638 raft_consensus.cc:3060] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:26.969264   486 raft_consensus.cc:3060] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:26.970162   486 raft_consensus.cc:2468] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 608afee16fb54cb294e2e5a5df78c0bc in term 1.
I20260812 08:01:26.970161   638 raft_consensus.cc:2468] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 608afee16fb54cb294e2e5a5df78c0bc in term 1.
I20260812 08:01:26.970580 32731 leader_election.cc:304] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d56ff6354484c53adc704d2bdfd365a, 608afee16fb54cb294e2e5a5df78c0bc; no voters: 
I20260812 08:01:26.970883   734 raft_consensus.cc:2804] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:26.971179   734 raft_consensus.cc:697] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 1 LEADER]: Becoming Leader. State: Replica: 608afee16fb54cb294e2e5a5df78c0bc, State: Running, Role: LEADER
I20260812 08:01:26.971542   734 consensus_queue.cc:237] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:26.975071 32644 catalog_manager.cc:5719] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 608afee16fb54cb294e2e5a5df78c0bc (127.29.198.1). New cstate: current_term: 1 leader_uuid: "608afee16fb54cb294e2e5a5df78c0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } health_report { overall_health: UNKNOWN } } }
W20260812 08:01:26.996410   385 tablet.cc:2406] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:27.070381 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
W20260812 08:01:27.102142   694 tablet.cc:2406] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:27.172041   539 tablet.cc:2406] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:27.273499 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
I20260812 08:01:27.445812   734 consensus_queue.cc:1048] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:27.452167   746 consensus_queue.cc:1048] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:27.577316 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 541
I20260812 08:01:27.590847   333 consensus_queue.cc:237] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:27.592286   486 raft_consensus.cc:1275] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [term 1 FOLLOWER]: Refusing update from remote peer 608afee16fb54cb294e2e5a5df78c0bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:27.592756   746 consensus_queue.cc:1048] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:01:27.594722   734 raft_consensus.cc:2955] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 0d7a24334ff1431782410b5038389588 (127.29.198.3) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } } }
I20260812 08:01:27.595196   486 raft_consensus.cc:2955] T f44fe50296064244a05be153caaf5547 P 2d56ff6354484c53adc704d2bdfd365a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 0d7a24334ff1431782410b5038389588 (127.29.198.3) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } } }
I20260812 08:01:27.597755 32644 catalog_manager.cc:5719] T f44fe50296064244a05be153caaf5547 P 608afee16fb54cb294e2e5a5df78c0bc reported cstate change: config changed from index -1 to 2, VOTER 0d7a24334ff1431782410b5038389588 (127.29.198.3) evicted. New cstate: current_term: 1 leader_uuid: "608afee16fb54cb294e2e5a5df78c0bc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } health_report { overall_health: HEALTHY } } }
W20260812 08:01:27.601188 32625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:43495: connect: Connection refused (error 111)
W20260812 08:01:27.602087 32625 catalog_manager.cc:4777] TS 0d7a24334ff1431782410b5038389588 (127.29.198.3:43495): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f44fe50296064244a05be153caaf5547: Network error: Client connection negotiation failed: client connection to 127.29.198.3:43495: connect: Connection refused (error 111)
I20260812 08:01:27.610491 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 32712
I20260812 08:01:27.624219 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 387
I20260812 08:01:27.635327 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:43495
--local_ip_for_outbound_sockets=127.29.198.3
--tserver_master_addrs=127.29.198.62:45715
--webserver_port=40563
--webserver_interface=127.29.198.3
--builtin_ntp_servers=127.29.198.20:45509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:27.744019   756 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:27.744341   756 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:27.744364   756 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:27.744411   756 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:27.747700   756 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:27.747815   756 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:27.751696   756 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:45509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:43495
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=40563
--tserver_master_addrs=127.29.198.62:45715
--never_fsync=true
--heap_profile_path=/tmp/kudu.756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:27.752899   756 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:27.754022   756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:27.761189   761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:27.761179   762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:27.761183   764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:27.761544   756 server_base.cc:1061] running on GCE node
I20260812 08:01:27.761893   756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:27.762408   756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:27.763567   756 hybrid_clock.cc:648] HybridClock initialized: now 1786521687763544 us; error 36 us; skew 500 ppm
I20260812 08:01:27.765460   756 webserver.cc:533] Webserver started at http://127.29.198.3:40563/ using document root <none> and password file <none>
I20260812 08:01:27.766044   756 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:27.766117   756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:27.769634   756 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:27.771549   770 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:27.772619   756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:27.772739   756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "0d7a24334ff1431782410b5038389588"
format_stamp: "Formatted at 2026-08-12 08:01:26 on dist-test-slave-1zqn"
I20260812 08:01:27.773119   756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:27.801466   756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:27.802189   756 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:27.802387   756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:27.803000   756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:27.804322   778 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:01:27.807870   756 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:01:27.807931   756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:01:27.807987   756 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:01:27.809531   756 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:01:27.809576   756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:01:27.809931   778 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Bootstrap starting.
I20260812 08:01:27.821964   756 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:43495
I20260812 08:01:27.822070   908 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:43495 every 8 connection(s)
I20260812 08:01:27.823096   756 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:27.826784   778 log.cc:826] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:27.829334   778 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:27.829702   778 tablet_bootstrap.cc:492] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Bootstrap complete.
I20260812 08:01:27.831143   778 ts_tablet_manager.cc:1403] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260812 08:01:27.832255   909 heartbeater.cc:344] Connected to a master server at 127.29.198.62:45715
I20260812 08:01:27.832388 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 756
I20260812 08:01:27.832542   909 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:27.833163   909 heartbeater.cc:507] Master 127.29.198.62:45715 requested a full tablet report, sending...
I20260812 08:01:27.834025   778 raft_consensus.cc:359] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:27.834429   778 raft_consensus.cc:740] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7a24334ff1431782410b5038389588, State: Initialized, Role: FOLLOWER
I20260812 08:01:27.834771   778 consensus_queue.cc:260] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7a24334ff1431782410b5038389588" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 43495 } } peers { permanent_uuid: "608afee16fb54cb294e2e5a5df78c0bc" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 41237 } } peers { permanent_uuid: "2d56ff6354484c53adc704d2bdfd365a" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 37833 } }
I20260812 08:01:27.835227 32644 ts_manager.cc:194] Re-registered known tserver with Master: 0d7a24334ff1431782410b5038389588 (127.29.198.3:43495)
I20260812 08:01:27.835733   778 ts_tablet_manager.cc:1434] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260812 08:01:27.836300 32644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:36095
I20260812 08:01:27.837893   909 heartbeater.cc:499] Master 127.29.198.62:45715 was elected leader, sending a full tablet report...
I20260812 08:01:27.976110   831 tablet_service.cc:1558] Processing DeleteTablet for tablet f44fe50296064244a05be153caaf5547 with delete_type TABLET_DATA_TOMBSTONED (TS 0d7a24334ff1431782410b5038389588 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:55214
I20260812 08:01:27.977017   917 tablet_replica.cc:333] stopping tablet replica
I20260812 08:01:27.977398   917 raft_consensus.cc:2243] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:01:27.977710   917 raft_consensus.cc:2272] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:01:27.978788   917 ts_tablet_manager.cc:1916] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:01:27.982203   917 ts_tablet_manager.cc:1929] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:01:27.982316   917 log.cc:1199] T f44fe50296064244a05be153caaf5547 P 0d7a24334ff1431782410b5038389588: Deleting WAL directory at /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport.1786521667469487-30488-0/minicluster-data/ts-2/wal/wals/f44fe50296064244a05be153caaf5547
I20260812 08:01:27.983337 32625 catalog_manager.cc:5050] TS 0d7a24334ff1431782410b5038389588 (127.29.198.3:43495): tablet f44fe50296064244a05be153caaf5547 (table test-workload [id=58a2f61b121948f588cff803ad67f578]) successfully deleted
I20260812 08:01:27.985772 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 756
I20260812 08:01:27.997697 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 32608
2026-08-12T08:01:28Z chronyd exiting
[       OK ] TabletReplacementITest.TestMasterTombstoneOldReplicaOnReport (1963 ms)
[ RUN      ] TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits
2026-08-12T08:01:28Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:28Z Disabled control of system clock
I20260812 08:01:28.032368 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:41609
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:41609
--master_add_server_when_underreplicated=false
--master_tombstone_evicted_tablet_replicas=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:01:28.139683   922 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.139905   922 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.139946   922 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.143281   922 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:28.143342   922 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.143362   922 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:28.143380   922 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:28.147274   922 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--master_add_server_when_underreplicated=false
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:41609
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:41609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.148456   922 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.149544   922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.155331   931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.155337   928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.155510   922 server_base.cc:1061] running on GCE node
W20260812 08:01:28.155373   929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.156231   922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.157114   922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.158293   922 hybrid_clock.cc:648] HybridClock initialized: now 1786521688158276 us; error 34 us; skew 500 ppm
I20260812 08:01:28.160475   922 webserver.cc:533] Webserver started at http://127.29.198.62:35771/ using document root <none> and password file <none>
I20260812 08:01:28.161069   922 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.161129   922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.161350   922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.163003   922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "d473d334319b4d51a2e657910e6d057e"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.163515   922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "d473d334319b4d51a2e657910e6d057e"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.166998   922 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:01:28.169423   938 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.170548   922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:28.170712   922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "d473d334319b4d51a2e657910e6d057e"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.170837   922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:28.183284   922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.184006   922 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.184273   922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.192845   999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:41609 every 8 connection(s)
I20260812 08:01:28.192860   922 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:41609
I20260812 08:01:28.193977   922 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:28.196835  1000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.198210 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 922
I20260812 08:01:28.198350 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:28.202610  1000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e: Bootstrap starting.
I20260812 08:01:28.204865  1000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.205619  1000 log.cc:826] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.207559  1000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e: No bootstrap required, opened a new log
I20260812 08:01:28.210039  1000 raft_consensus.cc:359] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d473d334319b4d51a2e657910e6d057e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41609 } }
I20260812 08:01:28.210215  1000 raft_consensus.cc:385] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:28.210258  1000 raft_consensus.cc:740] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d473d334319b4d51a2e657910e6d057e, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.210588  1000 consensus_queue.cc:260] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d473d334319b4d51a2e657910e6d057e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41609 } }
I20260812 08:01:28.210691  1000 raft_consensus.cc:399] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:28.210726  1000 raft_consensus.cc:493] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:28.210799  1000 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.211515  1000 raft_consensus.cc:515] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d473d334319b4d51a2e657910e6d057e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41609 } }
I20260812 08:01:28.211802  1000 leader_election.cc:304] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d473d334319b4d51a2e657910e6d057e; no voters: 
I20260812 08:01:28.212033  1000 leader_election.cc:290] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:28.212210  1005 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:28.212477  1005 raft_consensus.cc:697] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [term 1 LEADER]: Becoming Leader. State: Replica: d473d334319b4d51a2e657910e6d057e, State: Running, Role: LEADER
I20260812 08:01:28.212792  1005 consensus_queue.cc:237] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d473d334319b4d51a2e657910e6d057e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41609 } }
I20260812 08:01:28.213228  1000 sys_catalog.cc:565] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:28.214032  1008 sys_catalog.cc:455] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d473d334319b4d51a2e657910e6d057e. Latest consensus state: current_term: 1 leader_uuid: "d473d334319b4d51a2e657910e6d057e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d473d334319b4d51a2e657910e6d057e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41609 } } }
I20260812 08:01:28.214174  1008 sys_catalog.cc:458] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:28.214418  1007 sys_catalog.cc:455] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d473d334319b4d51a2e657910e6d057e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d473d334319b4d51a2e657910e6d057e" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41609 } } }
I20260812 08:01:28.214524  1007 sys_catalog.cc:458] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:28.214655  1016 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:28.218274  1016 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:28.223726  1016 catalog_manager.cc:1383] Generated new cluster ID: 6acf727748e14192be05e63974c8278e
I20260812 08:01:28.223872  1016 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:28.248466  1016 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:28.249691  1016 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:28.270969  1016 catalog_manager.cc:6092] T 00000000000000000000000000000000 P d473d334319b4d51a2e657910e6d057e: Generated new TSK 0
I20260812 08:01:28.271740  1016 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:28.280429 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41609
--builtin_ntp_servers=127.29.198.20:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:28.389092  1028 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:28.389348  1028 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.389392  1028 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.389467  1028 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.392957  1028 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.393124  1028 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:28.396996  1028 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.1028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.398105  1028 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.399292  1028 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.405815  1039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.405866  1035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.405827  1036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.406185  1028 server_base.cc:1061] running on GCE node
I20260812 08:01:28.406584  1028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.407087  1028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.408239  1028 hybrid_clock.cc:648] HybridClock initialized: now 1786521688408221 us; error 30 us; skew 500 ppm
I20260812 08:01:28.409984  1028 webserver.cc:533] Webserver started at http://127.29.198.1:40351/ using document root <none> and password file <none>
I20260812 08:01:28.410511  1028 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.410573  1028 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.410732  1028 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.412364  1028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "b2abc2aa26b7442686a9b03e791b89b3"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.412854  1028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "b2abc2aa26b7442686a9b03e791b89b3"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.416144  1028 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:28.418315  1046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.419461  1028 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:28.419620  1028 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "b2abc2aa26b7442686a9b03e791b89b3"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.419734  1028 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:28.431511  1028 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.432324  1028 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.432564  1028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.433260  1028 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:28.434453  1028 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:28.434532  1028 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.434613  1028 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:28.434660  1028 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.445631  1028 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:44603
I20260812 08:01:28.445655  1177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:44603 every 8 connection(s)
I20260812 08:01:28.446638  1028 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:28.447135 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 1028
I20260812 08:01:28.447256 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:28.449942 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41609
--builtin_ntp_servers=127.29.198.20:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:28.456239  1178 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41609
I20260812 08:01:28.456544  1178 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:28.457221  1178 heartbeater.cc:507] Master 127.29.198.62:41609 requested a full tablet report, sending...
I20260812 08:01:28.459335   957 ts_manager.cc:194] Registered new tserver with Master: b2abc2aa26b7442686a9b03e791b89b3 (127.29.198.1:44603)
I20260812 08:01:28.461109   957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:42713
W20260812 08:01:28.557746  1181 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:28.557987  1181 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.558012  1181 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.558054  1181 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.561388  1181 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.561494  1181 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:28.565310  1181 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.1181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.566381  1181 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.567514  1181 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.574069  1191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.574133  1194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.574084  1190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.574270  1181 server_base.cc:1061] running on GCE node
I20260812 08:01:28.574733  1181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.575361  1181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.576611  1181 hybrid_clock.cc:648] HybridClock initialized: now 1786521688576603 us; error 34 us; skew 500 ppm
I20260812 08:01:28.578339  1181 webserver.cc:533] Webserver started at http://127.29.198.2:34499/ using document root <none> and password file <none>
I20260812 08:01:28.578881  1181 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.578934  1181 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.579103  1181 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.580665  1181 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.581117  1181 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.584434  1181 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:28.586611  1200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.587589  1181 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:28.587684  1181 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.587759  1181 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:28.603531  1181 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.604264  1181 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.604476  1181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.605116  1181 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:28.606154  1181 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:28.606202  1181 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.606241  1181 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:28.606304  1181 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.617190  1181 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:45285
I20260812 08:01:28.617286  1333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:45285 every 8 connection(s)
I20260812 08:01:28.618256  1181 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:28.627117 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 1181
I20260812 08:01:28.627247 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:28.627221  1334 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41609
I20260812 08:01:28.627465  1334 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:28.628008  1334 heartbeater.cc:507] Master 127.29.198.62:41609 requested a full tablet report, sending...
I20260812 08:01:28.629024   957 ts_manager.cc:194] Registered new tserver with Master: 5d3ffabb9cdb4b18b1a46fdc09c7daa7 (127.29.198.2:45285)
I20260812 08:01:28.629451 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41609
--builtin_ntp_servers=127.29.198.20:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:28.629652   957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:50037
W20260812 08:01:28.737401  1337 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:28.737638  1337 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.737661  1337 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.737702  1337 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.741025  1337 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.741137  1337 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:28.744977  1337 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.1337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.746178  1337 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.747313  1337 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.754119  1346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.754119  1343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.754135  1344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.754271  1337 server_base.cc:1061] running on GCE node
I20260812 08:01:28.754829  1337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.755534  1337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.756744  1337 hybrid_clock.cc:648] HybridClock initialized: now 1786521688756721 us; error 42 us; skew 500 ppm
I20260812 08:01:28.758876  1337 webserver.cc:533] Webserver started at http://127.29.198.3:36569/ using document root <none> and password file <none>
I20260812 08:01:28.759545  1337 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.759686  1337 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.759912  1337 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.761693  1337 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "ad52ed5148f74383987c76dfb757a7f4"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.762212  1337 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "ad52ed5148f74383987c76dfb757a7f4"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.765913  1337 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:28.768700  1352 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.769831  1337 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:28.769963  1337 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "ad52ed5148f74383987c76dfb757a7f4"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-1zqn"
I20260812 08:01:28.770081  1337 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:28.782460  1337 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.783120  1337 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.783315  1337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.783879  1337 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:28.784936  1337 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:28.785009  1337 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.785076  1337 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:28.785128  1337 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.795509  1337 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:35957
I20260812 08:01:28.795579  1489 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:35957 every 8 connection(s)
I20260812 08:01:28.796593  1337 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:28.804908  1490 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41609
I20260812 08:01:28.805188  1490 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:28.805692  1490 heartbeater.cc:507] Master 127.29.198.62:41609 requested a full tablet report, sending...
I20260812 08:01:28.806316 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 1337
I20260812 08:01:28.806408 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:28.806888   957 ts_manager.cc:194] Registered new tserver with Master: ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3:35957)
I20260812 08:01:28.807608   957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:33893
I20260812 08:01:28.808815 30488 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:28.826442   957 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53624:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:28.827625   957 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:28.845328  1101 tablet_service.cc:1511] Processing CreateTablet for tablet 280fc910ceb54e9e9bee1d21eb167995 (DEFAULT_TABLE table=test-workload [id=2b9cb597c81d45719aeec90b50d25a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:28.845391  1415 tablet_service.cc:1511] Processing CreateTablet for tablet 280fc910ceb54e9e9bee1d21eb167995 (DEFAULT_TABLE table=test-workload [id=2b9cb597c81d45719aeec90b50d25a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:28.845393  1256 tablet_service.cc:1511] Processing CreateTablet for tablet 280fc910ceb54e9e9bee1d21eb167995 (DEFAULT_TABLE table=test-workload [id=2b9cb597c81d45719aeec90b50d25a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:28.846276  1101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280fc910ceb54e9e9bee1d21eb167995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.846294  1415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280fc910ceb54e9e9bee1d21eb167995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.846295  1256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280fc910ceb54e9e9bee1d21eb167995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.851280  1514 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Bootstrap starting.
I20260812 08:01:28.852563  1515 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: Bootstrap starting.
I20260812 08:01:28.852777  1516 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Bootstrap starting.
I20260812 08:01:28.853952  1514 tablet_bootstrap.cc:654] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.854683  1514 log.cc:826] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.854794  1516 tablet_bootstrap.cc:654] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.854794  1515 tablet_bootstrap.cc:654] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.855608  1515 log.cc:826] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.855608  1516 log.cc:826] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.856470  1514 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: No bootstrap required, opened a new log
I20260812 08:01:28.856688  1514 ts_tablet_manager.cc:1403] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:28.857360  1516 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: No bootstrap required, opened a new log
I20260812 08:01:28.857360  1515 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: No bootstrap required, opened a new log
I20260812 08:01:28.857542  1515 ts_tablet_manager.cc:1403] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:28.857542  1516 ts_tablet_manager.cc:1403] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:28.859568  1514 raft_consensus.cc:359] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.859782  1514 raft_consensus.cc:740] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2abc2aa26b7442686a9b03e791b89b3, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.860136  1514 consensus_queue.cc:260] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.860599  1515 raft_consensus.cc:359] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.860597  1516 raft_consensus.cc:359] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.860807  1515 raft_consensus.cc:740] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d3ffabb9cdb4b18b1a46fdc09c7daa7, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.860811  1516 raft_consensus.cc:740] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad52ed5148f74383987c76dfb757a7f4, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.860819  1178 heartbeater.cc:499] Master 127.29.198.62:41609 was elected leader, sending a full tablet report...
I20260812 08:01:28.861045  1514 ts_tablet_manager.cc:1434] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:28.861104  1516 consensus_queue.cc:260] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.861104  1515 consensus_queue.cc:260] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.861919  1515 ts_tablet_manager.cc:1434] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:28.861919  1516 ts_tablet_manager.cc:1434] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:28.862160  1334 heartbeater.cc:499] Master 127.29.198.62:41609 was elected leader, sending a full tablet report...
I20260812 08:01:28.862197  1490 heartbeater.cc:499] Master 127.29.198.62:41609 was elected leader, sending a full tablet report...
W20260812 08:01:28.869237  1335 tablet.cc:2406] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:28.884467  1126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "280fc910ceb54e9e9bee1d21eb167995"
dest_uuid: "b2abc2aa26b7442686a9b03e791b89b3"
 from {username='slave'} at 127.0.0.1:56978
I20260812 08:01:28.884678  1126 raft_consensus.cc:493] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:28.884765  1126 raft_consensus.cc:3060] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.885670  1126 raft_consensus.cc:515] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.886602  1126 leader_election.cc:290] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [CANDIDATE]: Term 1 election: Requested vote from peers ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3:35957), 5d3ffabb9cdb4b18b1a46fdc09c7daa7 (127.29.198.2:45285)
I20260812 08:01:28.890020 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:01:28.890945  1437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280fc910ceb54e9e9bee1d21eb167995" candidate_uuid: "b2abc2aa26b7442686a9b03e791b89b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ad52ed5148f74383987c76dfb757a7f4"
I20260812 08:01:28.891167  1437 raft_consensus.cc:3060] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.892320  1437 raft_consensus.cc:2468] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2abc2aa26b7442686a9b03e791b89b3 in term 1.
I20260812 08:01:28.892606  1281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280fc910ceb54e9e9bee1d21eb167995" candidate_uuid: "b2abc2aa26b7442686a9b03e791b89b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7"
I20260812 08:01:28.892731  1049 leader_election.cc:304] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad52ed5148f74383987c76dfb757a7f4, b2abc2aa26b7442686a9b03e791b89b3; no voters: 
I20260812 08:01:28.892802  1281 raft_consensus.cc:3060] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.893028  1521 raft_consensus.cc:2804] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:28.893286  1521 raft_consensus.cc:697] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 1 LEADER]: Becoming Leader. State: Replica: b2abc2aa26b7442686a9b03e791b89b3, State: Running, Role: LEADER
I20260812 08:01:28.893618  1521 consensus_queue.cc:237] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:28.893908  1281 raft_consensus.cc:2468] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2abc2aa26b7442686a9b03e791b89b3 in term 1.
I20260812 08:01:28.897027   956 catalog_manager.cc:5719] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2abc2aa26b7442686a9b03e791b89b3 (127.29.198.1). New cstate: current_term: 1 leader_uuid: "b2abc2aa26b7442686a9b03e791b89b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } health_report { overall_health: HEALTHY } } }
W20260812 08:01:28.948019  1179 tablet.cc:2406] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:28.993412 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
W20260812 08:01:29.047695  1491 tablet.cc:2406] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:29.196509 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 1.1
I20260812 08:01:29.385954  1521 consensus_queue.cc:1048] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:29.392088  1527 consensus_queue.cc:1048] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:29.510713  1171 generic_service.cc:175] {username='slave'} at 127.0.0.1:56978 changed flags via RPC: tablet_inject_latency_on_apply_write_op_ms from '0' to '5000'
I20260812 08:01:29.513787 30488 cluster_itest_util.cc:258] Not converged past 3 yet: 1.2 1.2 1.3
I20260812 08:01:29.620944  1126 consensus_queue.cc:237] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } }
I20260812 08:01:29.622363  1281 raft_consensus.cc:1275] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 1 FOLLOWER]: Refusing update from remote peer b2abc2aa26b7442686a9b03e791b89b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 08:01:29.622880  1540 consensus_queue.cc:1048] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:01:29.624706  1527 raft_consensus.cc:2955] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }
I20260812 08:01:29.625140  1281 raft_consensus.cc:2955] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, VOTER ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }
I20260812 08:01:29.627226  1415 tablet_service.cc:1558] Processing DeleteTablet for tablet 280fc910ceb54e9e9bee1d21eb167995 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:55360
I20260812 08:01:29.627537   955 catalog_manager.cc:5719] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 reported cstate change: config changed from index -1 to 4, VOTER ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3) evicted. New cstate: current_term: 1 leader_uuid: "b2abc2aa26b7442686a9b03e791b89b3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } health_report { overall_health: HEALTHY } } }
I20260812 08:01:29.627875  1547 tablet_replica.cc:333] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: stopping tablet replica
I20260812 08:01:29.628188  1547 raft_consensus.cc:2243] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:01:29.628399  1547 raft_consensus.cc:2272] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:01:29.629635  1547 ts_tablet_manager.cc:1916] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:01:29.631923  1547 ts_tablet_manager.cc:1929] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260812 08:01:29.632011  1547 log.cc:1199] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Deleting WAL directory at /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/wal/wals/280fc910ceb54e9e9bee1d21eb167995
I20260812 08:01:29.633514  1126 consensus_queue.cc:237] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } }
I20260812 08:01:29.634758  1281 raft_consensus.cc:1275] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 1 FOLLOWER]: Refusing update from remote peer b2abc2aa26b7442686a9b03e791b89b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20260812 08:01:29.635051  1049 consensus_peers.cc:597] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 -> Peer ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3:35957): Couldn't send request to peer ad52ed5148f74383987c76dfb757a7f4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:29.635260  1540 consensus_queue.cc:1048] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:01:29.636963  1543 raft_consensus.cc:2955] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } } }
I20260812 08:01:29.637441  1281 raft_consensus.cc:2955] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, VOTER ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } } }
I20260812 08:01:29.639914   956 catalog_manager.cc:5719] T 280fc910ceb54e9e9bee1d21eb167995 P 5d3ffabb9cdb4b18b1a46fdc09c7daa7 reported cstate change: config changed from index 4 to 5, VOTER ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3) added. New cstate: current_term: 1 leader_uuid: "b2abc2aa26b7442686a9b03e791b89b3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } } }
I20260812 08:01:30.253511  1554 ts_tablet_manager.cc:933] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Initiating tablet copy from peer b2abc2aa26b7442686a9b03e791b89b3 (127.29.198.1:44603)
I20260812 08:01:30.254048  1554 tablet_copy_client.cc:323] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.198.1:44603
I20260812 08:01:30.258538  1149 tablet_copy_service.cc:140] P b2abc2aa26b7442686a9b03e791b89b3: Received BeginTabletCopySession request for tablet 280fc910ceb54e9e9bee1d21eb167995 from peer ad52ed5148f74383987c76dfb757a7f4 ({username='slave'} at 127.29.198.3:38977)
I20260812 08:01:30.258687  1149 tablet_copy_service.cc:161] P b2abc2aa26b7442686a9b03e791b89b3: Beginning new tablet copy session on tablet 280fc910ceb54e9e9bee1d21eb167995 from peer ad52ed5148f74383987c76dfb757a7f4 at {username='slave'} at 127.29.198.3:38977: session id = ad52ed5148f74383987c76dfb757a7f4-280fc910ceb54e9e9bee1d21eb167995
I20260812 08:01:30.259922  1149 tablet_copy_source_session.cc:215] T 280fc910ceb54e9e9bee1d21eb167995 P b2abc2aa26b7442686a9b03e791b89b3: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:01:30.261272  1554 ts_tablet_manager.cc:1916] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:01:30.263459  1554 ts_tablet_manager.cc:1929] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.3
I20260812 08:01:30.263653  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280fc910ceb54e9e9bee1d21eb167995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:30.264748  1554 tablet_copy_client.cc:806] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: tablet copy: Starting download of 0 data blocks...
I20260812 08:01:30.264963  1554 tablet_copy_client.cc:670] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:01:30.266948  1554 tablet_copy_client.cc:538] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:01:30.268409  1554 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Bootstrap starting.
I20260812 08:01:30.273689  1554 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260812 08:01:30.274027  1554 tablet_bootstrap.cc:492] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Bootstrap complete.
I20260812 08:01:30.274211  1554 ts_tablet_manager.cc:1403] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.001s
I20260812 08:01:30.274767  1554 raft_consensus.cc:359] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } }
I20260812 08:01:30.275321  1554 raft_consensus.cc:886] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Ignoring setting pending config change with OpId 1.4 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }
I20260812 08:01:30.275444  1554 raft_consensus.cc:886] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Ignoring setting pending config change with OpId 1.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } } }
I20260812 08:01:30.275661  1554 raft_consensus.cc:2962] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Ignoring commit of config change with OpId 1.4 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } } peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }
I20260812 08:01:30.276070  1554 raft_consensus.cc:2962] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Ignoring commit of config change with OpId 1.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } } }
I20260812 08:01:30.276463  1554 raft_consensus.cc:740] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad52ed5148f74383987c76dfb757a7f4, State: Initialized, Role: FOLLOWER
I20260812 08:01:30.276629  1554 consensus_queue.cc:260] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5d3ffabb9cdb4b18b1a46fdc09c7daa7" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 45285 } } peers { permanent_uuid: "b2abc2aa26b7442686a9b03e791b89b3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 44603 } } peers { permanent_uuid: "ad52ed5148f74383987c76dfb757a7f4" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 35957 } attrs { } }
I20260812 08:01:30.276924  1554 ts_tablet_manager.cc:1434] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.004s
I20260812 08:01:30.277632  1149 tablet_copy_service.cc:342] P b2abc2aa26b7442686a9b03e791b89b3: Request end of tablet copy session ad52ed5148f74383987c76dfb757a7f4-280fc910ceb54e9e9bee1d21eb167995 received from {username='slave'} at 127.29.198.3:38977
I20260812 08:01:30.277757  1149 tablet_copy_service.cc:434] P b2abc2aa26b7442686a9b03e791b89b3: ending tablet copy session ad52ed5148f74383987c76dfb757a7f4-280fc910ceb54e9e9bee1d21eb167995 on tablet 280fc910ceb54e9e9bee1d21eb167995 with peer ad52ed5148f74383987c76dfb757a7f4
I20260812 08:01:30.341849  1101 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:01:30.341892  1415 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:30.341892  1256 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 d473d334319b4d51a2e657910e6d057e | 127.29.198.62:41609 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                                                 Value                                                                                                 |      Tags       |         Master
------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 master_add_server_when_underreplicated               | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 master_tombstone_evicted_tablet_replicas             | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                                                                  | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                                                                     | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                                                                  | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                                                                  | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                                                                    | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                                                                   | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value        |         Master
---------------------+---------------------+-------------------------
 builtin_ntp_servers | 127.29.198.20:34771 | all 1 server(s) checked
 time_source         | builtin             | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
 5d3ffabb9cdb4b18b1a46fdc09c7daa7 | 127.29.198.2:45285 | HEALTHY | <none>   |       0        |       0
 ad52ed5148f74383987c76dfb757a7f4 | 127.29.198.3:35957 | HEALTHY | <none>   |       0        |       0
 b2abc2aa26b7442686a9b03e791b89b3 | 127.29.198.1:44603 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                    |                                                                                               Value                                                                                               |      Tags       |      Tablet Server
--------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection            | false                                                                                                                                                                                             | unsafe          | all 3 server(s) checked
 ipki_server_key_size                       | 768                                                                                                                                                                                               | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets              | 127.29.198.1                                                                                                                                                                                      | experimental    | 127.29.198.1:44603
 local_ip_for_outbound_sockets              | 127.29.198.2                                                                                                                                                                                      | experimental    | 127.29.198.2:45285
 local_ip_for_outbound_sockets              | 127.29.198.3                                                                                                                                                                                      | experimental    | 127.29.198.3:35957
 never_fsync                                | true                                                                                                                                                                                              | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override            | 0                                                                                                                                                                                                 | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports           | true                                                                                                                                                                                              | unsafe          | all 3 server(s) checked
 server_dump_info_format                    | pb                                                                                                                                                                                                | hidden          | all 3 server(s) checked
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.29.198.1:44603
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.29.198.2:45285
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.29.198.3:35957
 tablet_inject_latency_on_apply_write_op_ms | 5000                                                                                                                                                                                              | runtime,unsafe  | 127.29.198.1:44603

Flags of checked categories for Tablet Server:
        Flag         |        Value        |      Tablet Server
---------------------+---------------------+-------------------------
 builtin_ntp_servers | 127.29.198.20:34771 | all 3 server(s) checked
 time_source         | builtin             | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 280fc910ceb54e9e9bee1d21eb167995 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  5d3ffabb9cdb4b18b1a46fdc09c7daa7 (127.29.198.2:45285): RUNNING
  b2abc2aa26b7442686a9b03e791b89b3 (127.29.198.1:44603): RUNNING [LEADER]
  ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3:35957): RUNNING
All reported replicas are:
  A = 5d3ffabb9cdb4b18b1a46fdc09c7daa7
  B = b2abc2aa26b7442686a9b03e791b89b3
  C = ad52ed5148f74383987c76dfb757a7f4
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B*  C    | 1            | 5            | Yes
 B             | A   B*  C    | 1            | 5            | Yes
 C             | A   B   C    | 1            | 5            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:01:30.370525 30488 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:01:30.570919  1256 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:30.570977  1415 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:30.571410  1101 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 d473d334319b4d51a2e657910e6d057e | 127.29.198.62:41609 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                                                 Value                                                                                                 |      Tags       |         Master
------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 master_add_server_when_underreplicated               | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 master_tombstone_evicted_tablet_replicas             | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                                                                  | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                                                                     | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                                                                  | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                                                                  | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                                                                    | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                                                                   | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value        |         Master
---------------------+---------------------+-------------------------
 builtin_ntp_servers | 127.29.198.20:34771 | all 1 server(s) checked
 time_source         | builtin             | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
 5d3ffabb9cdb4b18b1a46fdc09c7daa7 | 127.29.198.2:45285 | HEALTHY | <none>   |       0        |       0
 ad52ed5148f74383987c76dfb757a7f4 | 127.29.198.3:35957 | HEALTHY | <none>   |       0        |       0
 b2abc2aa26b7442686a9b03e791b89b3 | 127.29.198.1:44603 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                    |                                                                                               Value                                                                                               |      Tags       |      Tablet Server
--------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection            | false                                                                                                                                                                                             | unsafe          | all 3 server(s) checked
 ipki_server_key_size                       | 768                                                                                                                                                                                               | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets              | 127.29.198.1                                                                                                                                                                                      | experimental    | 127.29.198.1:44603
 local_ip_for_outbound_sockets              | 127.29.198.2                                                                                                                                                                                      | experimental    | 127.29.198.2:45285
 local_ip_for_outbound_sockets              | 127.29.198.3                                                                                                                                                                                      | experimental    | 127.29.198.3:35957
 never_fsync                                | true                                                                                                                                                                                              | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override            | 0                                                                                                                                                                                                 | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports           | true                                                                                                                                                                                              | unsafe          | all 3 server(s) checked
 server_dump_info_format                    | pb                                                                                                                                                                                                | hidden          | all 3 server(s) checked
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.29.198.1:44603
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.29.198.2:45285
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.29.198.3:35957
 tablet_inject_latency_on_apply_write_op_ms | 5000                                                                                                                                                                                              | runtime,unsafe  | 127.29.198.1:44603

Flags of checked categories for Tablet Server:
        Flag         |        Value        |      Tablet Server
---------------------+---------------------+-------------------------
 builtin_ntp_servers | 127.29.198.20:34771 | all 3 server(s) checked
 time_source         | builtin             | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 280fc910ceb54e9e9bee1d21eb167995 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  5d3ffabb9cdb4b18b1a46fdc09c7daa7 (127.29.198.2:45285): RUNNING
  b2abc2aa26b7442686a9b03e791b89b3 (127.29.198.1:44603): RUNNING [LEADER]
  ad52ed5148f74383987c76dfb757a7f4 (127.29.198.3:35957): RUNNING
All reported replicas are:
  A = 5d3ffabb9cdb4b18b1a46fdc09c7daa7
  B = b2abc2aa26b7442686a9b03e791b89b3
  C = ad52ed5148f74383987c76dfb757a7f4
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B*  C    | 1            | 5            | Yes
 B             | A   B*  C    | 1            | 5            | Yes
 C             | A   B   C    | 1            | 5            | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:01:30.594228 30488 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:01:30.806062  1437 raft_consensus.cc:1217] T 280fc910ceb54e9e9bee1d21eb167995 P ad52ed5148f74383987c76dfb757a7f4 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5]   Dedup: 1.5->[]
I20260812 08:01:30.870117  1101 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:01:30.870434  1415 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:30.871373  1256 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address       | Status
----------------------------------+---------------------+---------
 d473d334319b4d51a2e657910e6d057e | 127.29.198.62:41609 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                                                 Value                                                                                                 |      Tags       |         Master
------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                                                                   | experimental    | all 1 server(s) checked
 master_add_server_when_underreplicated               | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 master_tombstone_evicted_tablet_replicas             | false                                                                                                                                                                                                 | hidden          | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                                                                  | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                                                                     | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                                                                  | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                                                                  | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                                                                    | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                                                                   | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value        |         Master
---------------------+---------------------+-------------------------
 builtin_ntp_servers | 127.29.198.20:34771 | all 1 server(s) checked
 time_source         | builtin             | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address       | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
 5d3ffabb9cdb4b18b1a46fdc09c7daa7 | 127.29.198.2:45285 | HEALTHY | <none>   |       0        |       0
 ad52ed5148f74383987c76dfb757a7f4 | 127.29.198.3:35957 | HEALTHY | <none>   |       0        |       0
 b2abc2aa26b7442686a9b03e791b89b3 | 127.29.198.1:44603 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                    |                                                                                               Value                                                                                               |      Tags       |      Tablet Server
--------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection            | false                                                                                                                                                                                             | unsafe          | all 3 server(s) checked
 ipki_server_key_size                       | 768                                                                                                                                                                                               | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets              | 127.29.198.1                                                                                                                                                                                      | experimental    | 127.29.198.1:44603
 local_ip_for_outbound_sockets              | 127.29.198.2                                                                                                                                                                                      | experimental    | 127.29.198.2:45285
 local_ip_for_outbound_sockets              | 127.29.198.3                                                                                                                                                                                      | experimental    | 127.29.198.3:35957
 never_fsync                                | true                                                                                                                                                                                              | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override            | 0                                                                                                                                                                                                 | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports           | true                                                                                                                                                                                              | unsafe          | all 3 server(s) checked
 server_dump_info_format                    | pb                                                                                                                                                                                                | hidden          | all 3 server(s) checked
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.29.198.1:44603
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.29.198.2:45285
 server_dump_info_path                      | /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.29.198.3:35957
 tablet_inject_latency_on_apply_write_op_ms | 5000                                                                                                                                                                                              | runtime,unsafe  | 127.29.198.1:44603

Flags of checked categories for Tablet Server:
        Flag         |        Value        |      Tablet Server
---------------------+---------------------+-------------------------
 builtin_ntp_servers | 127.29.198.20:34771 | all 3 server(s) checked
 time_source         | builtin             | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:01:30.894987 30488 log_verifier.cc:126] Checking tablet 280fc910ceb54e9e9bee1d21eb167995
I20260812 08:01:30.923115 30488 log_verifier.cc:177] Verified matching terms for 5 ops in tablet 280fc910ceb54e9e9bee1d21eb167995
I20260812 08:01:34.515235  1544 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:56978 (request call id 9) took 5003 ms. Trace:
I20260812 08:01:34.515353  1544 rpcz_store.cc:276] 0812 08:01:29.511591 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:29.511666 (+    75us) service_pool.cc:224] Handling call
0812 08:01:34.515211 (+5003545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:29.512028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 280fc910ceb54e9e9bee1d21eb167995
0812 08:01:29.512151 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:29.512155 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:29.512156 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:29.512234 (+    78us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:29.512241 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:29.512244 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:29.512280 (+    36us) tablet.cc:701] Row locks acquired
0812 08:01:29.512283 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:01:29.512310 (+    27us) write_op.cc:270] Start()
0812 08:01:29.512330 (+    20us) write_op.cc:276] Timestamp: P: 1786521689512279 usec, L: 0
0812 08:01:29.512332 (+     2us) op_driver.cc:348] REPLICATION: starting
0812 08:01:29.512440 (+   108us) log.cc:844] Serialized 171 byte log entry
0812 08:01:29.514283 (+  1843us) op_driver.cc:464] REPLICATION: finished
0812 08:01:29.514374 (+    91us) write_op.cc:301] APPLY: starting
0812 08:01:29.514377 (+     3us) write_op.cc:306] Injecting 5000ms of latency due to --tablet_inject_latency_on_apply_write_op_ms
0812 08:01:34.514595 (+5000218us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:34.514633 (+    38us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:34.514635 (+     2us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:34.514724 (+    89us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:34.514812 (+    88us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:34.514819 (+     7us) write_op.cc:312] APPLY: finished
0812 08:01:34.514920 (+   101us) log.cc:844] Serialized 22 byte log entry
0812 08:01:34.515137 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:34.515152 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:34.515158 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":42,"num_ops":1,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":529,"prepare.run_wall_time_us":530,"raft.queue_time_us":156,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":540,"replication_time_us":1929,"spinlock_wait_cycles":298624,"thread_start_us":110,"threads_started":1,"wal-append.queue_time_us":238}]]}
I20260812 08:01:34.516875 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 1028
I20260812 08:01:34.528226 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 1181
I20260812 08:01:34.538417 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 1337
I20260812 08:01:34.549955 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 922
2026-08-12T08:01:34Z chronyd exiting
[       OK ] TabletReplacementITest.TestRemoteBoostrapWithPendingConfigChangeCommits (6557 ms)
[----------] 4 tests from TabletReplacementITest (27098 ms total)

[----------] 2 tests from EvictAndReplaceDeadFollowerITest
[ RUN      ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/0
2026-08-12T08:01:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:34Z Disabled control of system clock
I20260812 08:01:34.590049 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:37345
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:46033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:37345
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 08:01:34.701884  1674 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:34.702101  1674 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:34.702139  1674 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:34.705478  1674 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:34.705541  1674 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:34.705562  1674 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:34.705581  1674 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:34.705600  1674 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:34.709508  1674 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:37345
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:37345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:34.710602  1674 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:34.711699  1674 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:34.717475  1674 server_base.cc:1061] running on GCE node
W20260812 08:01:34.717410  1684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.717558  1681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.717417  1682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:34.718092  1674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:34.719066  1674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:34.720239  1674 hybrid_clock.cc:648] HybridClock initialized: now 1786521694720213 us; error 41 us; skew 500 ppm
I20260812 08:01:34.722039  1674 webserver.cc:533] Webserver started at http://127.29.198.62:42589/ using document root <none> and password file <none>
I20260812 08:01:34.722622  1674 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.722712  1674 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:34.722981  1674 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:34.724642  1674 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "5b673227aac644098cb95900c71575e9"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:34.725124  1674 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "5b673227aac644098cb95900c71575e9"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:34.728675  1674 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:34.731009  1693 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.731989  1674 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:34.732164  1674 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "5b673227aac644098cb95900c71575e9"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:34.732277  1674 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:34.743129  1674 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:34.743922  1674 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:34.744185  1674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:34.752833  1758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:37345 every 8 connection(s)
I20260812 08:01:34.752846  1674 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:37345
I20260812 08:01:34.754137  1674 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:34.756305 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 1674
I20260812 08:01:34.756434 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:34.757835  1759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:34.764775  1759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9: Bootstrap starting.
I20260812 08:01:34.767258  1759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:34.768098  1759 log.cc:826] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:34.769929  1759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9: No bootstrap required, opened a new log
I20260812 08:01:34.772666  1759 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b673227aac644098cb95900c71575e9" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37345 } }
I20260812 08:01:34.772848  1759 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:34.772917  1759 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b673227aac644098cb95900c71575e9, State: Initialized, Role: FOLLOWER
I20260812 08:01:34.773339  1759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b673227aac644098cb95900c71575e9" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37345 } }
I20260812 08:01:34.773463  1759 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:34.773572  1759 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:34.773701  1759 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:34.774537  1759 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b673227aac644098cb95900c71575e9" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37345 } }
I20260812 08:01:34.774879  1759 leader_election.cc:304] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b673227aac644098cb95900c71575e9; no voters: 
I20260812 08:01:34.775175  1759 leader_election.cc:290] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:34.775348  1766 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:34.775614  1766 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [term 1 LEADER]: Becoming Leader. State: Replica: 5b673227aac644098cb95900c71575e9, State: Running, Role: LEADER
I20260812 08:01:34.775938  1766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b673227aac644098cb95900c71575e9" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37345 } }
I20260812 08:01:34.776371  1759 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:34.777859  1768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b673227aac644098cb95900c71575e9. Latest consensus state: current_term: 1 leader_uuid: "5b673227aac644098cb95900c71575e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b673227aac644098cb95900c71575e9" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37345 } } }
I20260812 08:01:34.777837  1767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b673227aac644098cb95900c71575e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b673227aac644098cb95900c71575e9" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37345 } } }
I20260812 08:01:34.777992  1768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:34.777994  1767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:34.778916  1777 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:34.781744  1777 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:34.786983  1777 catalog_manager.cc:1383] Generated new cluster ID: 412b3a187e98460c9ace327eb0fe5802
I20260812 08:01:34.787052  1777 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:34.795724  1777 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:34.796716  1777 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:34.803251  1777 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 5b673227aac644098cb95900c71575e9: Generated new TSK 0
I20260812 08:01:34.803853  1777 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:34.811455 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37345
--builtin_ntp_servers=127.29.198.20:46033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 08:01:34.921561  1788 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:34.921819  1788 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:34.921892  1788 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:34.921999  1788 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:34.925398  1788 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:34.925498  1788 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:34.925598  1788 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:34.929553  1788 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37345
--never_fsync=true
--heap_profile_path=/tmp/kudu.1788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:34.930644  1788 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:34.931777  1788 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:34.938483  1799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.938489  1796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.938709  1801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:34.939386  1788 server_base.cc:1061] running on GCE node
I20260812 08:01:34.939812  1788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:34.940531  1788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:34.941733  1788 hybrid_clock.cc:648] HybridClock initialized: now 1786521694941704 us; error 57 us; skew 500 ppm
I20260812 08:01:34.944234  1788 webserver.cc:533] Webserver started at http://127.29.198.1:43331/ using document root <none> and password file <none>
I20260812 08:01:34.944957  1788 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.945051  1788 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:34.945271  1788 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:34.947492  1788 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "6e39329e3b634732b38a2ecaa221b115"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:34.948132  1788 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "6e39329e3b634732b38a2ecaa221b115"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:34.952919  1788 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:34.955665  1809 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.957005  1788 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:34.957126  1788 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "6e39329e3b634732b38a2ecaa221b115"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:34.957227  1788 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:34.973613  1788 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:34.974303  1788 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:34.974466  1788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:34.975039  1788 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:34.976104  1788 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:34.976153  1788 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.976224  1788 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:34.976265  1788 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.986509  1788 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:34743
I20260812 08:01:34.986541  1944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:34743 every 8 connection(s)
I20260812 08:01:34.987493  1788 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:34.989142 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 1788
I20260812 08:01:34.989243 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:34.991918 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37345
--builtin_ntp_servers=127.29.198.20:46033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
I20260812 08:01:34.997225  1945 heartbeater.cc:344] Connected to a master server at 127.29.198.62:37345
I20260812 08:01:34.997467  1945 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.997926  1945 heartbeater.cc:507] Master 127.29.198.62:37345 requested a full tablet report, sending...
I20260812 08:01:34.999640  1713 ts_manager.cc:194] Registered new tserver with Master: 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1:34743)
I20260812 08:01:35.001588  1713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:42489
W20260812 08:01:35.108315  1949 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:35.108564  1949 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:35.108594  1949 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:35.108636  1949 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:35.111997  1949 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:35.112078  1949 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:35.112147  1949 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:35.115875  1949 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37345
--never_fsync=true
--heap_profile_path=/tmp/kudu.1949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:35.116986  1949 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:35.118062  1949 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:35.124395  1955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:35.124413  1956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:35.124428  1958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:35.124706  1949 server_base.cc:1061] running on GCE node
I20260812 08:01:35.125172  1949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:35.125703  1949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:35.126880  1949 hybrid_clock.cc:648] HybridClock initialized: now 1786521695126851 us; error 47 us; skew 500 ppm
I20260812 08:01:35.128715  1949 webserver.cc:533] Webserver started at http://127.29.198.2:40231/ using document root <none> and password file <none>
I20260812 08:01:35.129388  1949 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:35.129477  1949 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:35.129690  1949 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:35.131210  1949 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "1d1a425acfe94b5caea11907e4f95bda"
format_stamp: "Formatted at 2026-08-12 08:01:35 on dist-test-slave-1zqn"
I20260812 08:01:35.131692  1949 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "1d1a425acfe94b5caea11907e4f95bda"
format_stamp: "Formatted at 2026-08-12 08:01:35 on dist-test-slave-1zqn"
I20260812 08:01:35.134997  1949 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:35.137388  1965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:35.138439  1949 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:35.138572  1949 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "1d1a425acfe94b5caea11907e4f95bda"
format_stamp: "Formatted at 2026-08-12 08:01:35 on dist-test-slave-1zqn"
I20260812 08:01:35.138676  1949 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:35.153075  1949 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:35.153774  1949 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:35.153986  1949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:35.154598  1949 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:35.155634  1949 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:35.155683  1949 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:35.155754  1949 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:35.155793  1949 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:35.165915  1949 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:38665
I20260812 08:01:35.165951  2091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:38665 every 8 connection(s)
I20260812 08:01:35.166934  1949 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:35.170148 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 1949
I20260812 08:01:35.170275 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:35.172909 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37345
--builtin_ntp_servers=127.29.198.20:46033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
I20260812 08:01:35.177156  2092 heartbeater.cc:344] Connected to a master server at 127.29.198.62:37345
I20260812 08:01:35.177443  2092 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:35.177930  2092 heartbeater.cc:507] Master 127.29.198.62:37345 requested a full tablet report, sending...
I20260812 08:01:35.179219  1713 ts_manager.cc:194] Registered new tserver with Master: 1d1a425acfe94b5caea11907e4f95bda (127.29.198.2:38665)
I20260812 08:01:35.180087  1713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:42717
W20260812 08:01:35.285976  2095 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:35.286239  2095 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:35.286265  2095 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:35.286309  2095 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:35.289788  2095 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:35.289870  2095 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:35.289938  2095 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:35.293838  2095 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37345
--never_fsync=true
--heap_profile_path=/tmp/kudu.2095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:35.294960  2095 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:35.296139  2095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:35.302809  2102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:35.302829  2104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:35.303164  2095 server_base.cc:1061] running on GCE node
W20260812 08:01:35.303226  2101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:35.303565  2095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:35.304163  2095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:35.305323  2095 hybrid_clock.cc:648] HybridClock initialized: now 1786521695305329 us; error 79 us; skew 500 ppm
I20260812 08:01:35.307222  2095 webserver.cc:533] Webserver started at http://127.29.198.3:36725/ using document root <none> and password file <none>
I20260812 08:01:35.307833  2095 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:35.307894  2095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:35.308164  2095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:35.309791  2095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c"
format_stamp: "Formatted at 2026-08-12 08:01:35 on dist-test-slave-1zqn"
I20260812 08:01:35.310321  2095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c"
format_stamp: "Formatted at 2026-08-12 08:01:35 on dist-test-slave-1zqn"
I20260812 08:01:35.313668  2095 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:35.316115  2113 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:35.317198  2095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:35.317332  2095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c"
format_stamp: "Formatted at 2026-08-12 08:01:35 on dist-test-slave-1zqn"
I20260812 08:01:35.317430  2095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:35.331348  2095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:35.332114  2095 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:35.332314  2095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:35.332902  2095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:35.333968  2095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:35.334041  2095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:35.334111  2095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:35.334164  2095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:35.344817  2095 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:36239
I20260812 08:01:35.344928  2246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:36239 every 8 connection(s)
I20260812 08:01:35.345884  2095 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:35.350612 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 2095
I20260812 08:01:35.350744 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:35.360136  2247 heartbeater.cc:344] Connected to a master server at 127.29.198.62:37345
I20260812 08:01:35.360419  2247 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:35.360929  2247 heartbeater.cc:507] Master 127.29.198.62:37345 requested a full tablet report, sending...
I20260812 08:01:35.362061  1713 ts_manager.cc:194] Registered new tserver with Master: 00b7cba1dbba4bd7a61f8f74896bfb4c (127.29.198.3:36239)
I20260812 08:01:35.362730  1713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:36175
I20260812 08:01:35.365152 30488 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:35.384471  1713 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54694:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:01:35.403329  1865 tablet_service.cc:1511] Processing CreateTablet for tablet 8c988be761034bffb8da8b3b5cfa20b4 (DEFAULT_TABLE table=test-workload [id=762bbe4025c34effa5ab89fc4cfe88b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:35.403393  2165 tablet_service.cc:1511] Processing CreateTablet for tablet 8c988be761034bffb8da8b3b5cfa20b4 (DEFAULT_TABLE table=test-workload [id=762bbe4025c34effa5ab89fc4cfe88b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:35.403393  2014 tablet_service.cc:1511] Processing CreateTablet for tablet 8c988be761034bffb8da8b3b5cfa20b4 (DEFAULT_TABLE table=test-workload [id=762bbe4025c34effa5ab89fc4cfe88b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:35.404315  1865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c988be761034bffb8da8b3b5cfa20b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:35.404325  2165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c988be761034bffb8da8b3b5cfa20b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:35.404325  2014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c988be761034bffb8da8b3b5cfa20b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:35.409400  2275 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Bootstrap starting.
I20260812 08:01:35.410620  2277 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Bootstrap starting.
I20260812 08:01:35.410620  2276 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: Bootstrap starting.
I20260812 08:01:35.412683  2275 tablet_bootstrap.cc:654] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:35.412812  2277 tablet_bootstrap.cc:654] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:35.412812  2276 tablet_bootstrap.cc:654] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:35.413479  2275 log.cc:826] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:35.413631  2276 log.cc:826] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:35.413631  2277 log.cc:826] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:35.415192  2275 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: No bootstrap required, opened a new log
I20260812 08:01:35.415284  2276 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: No bootstrap required, opened a new log
I20260812 08:01:35.415284  2277 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: No bootstrap required, opened a new log
I20260812 08:01:35.415442  2275 ts_tablet_manager.cc:1403] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:35.415480  2276 ts_tablet_manager.cc:1403] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:35.415494  2277 ts_tablet_manager.cc:1403] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:35.418121  2275 raft_consensus.cc:359] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.418329  2275 raft_consensus.cc:740] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e39329e3b634732b38a2ecaa221b115, State: Initialized, Role: FOLLOWER
I20260812 08:01:35.418655  2275 consensus_queue.cc:260] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.418666  2276 raft_consensus.cc:359] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.418663  2277 raft_consensus.cc:359] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.418872  2276 raft_consensus.cc:740] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d1a425acfe94b5caea11907e4f95bda, State: Initialized, Role: FOLLOWER
I20260812 08:01:35.418871  2277 raft_consensus.cc:740] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00b7cba1dbba4bd7a61f8f74896bfb4c, State: Initialized, Role: FOLLOWER
I20260812 08:01:35.419170  2276 consensus_queue.cc:260] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.419170  2277 consensus_queue.cc:260] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.419533  2275 ts_tablet_manager.cc:1434] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:35.419891  1945 heartbeater.cc:499] Master 127.29.198.62:37345 was elected leader, sending a full tablet report...
I20260812 08:01:35.420015  2277 ts_tablet_manager.cc:1434] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:35.420008  2276 ts_tablet_manager.cc:1434] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:35.420137  2092 heartbeater.cc:499] Master 127.29.198.62:37345 was elected leader, sending a full tablet report...
I20260812 08:01:35.420969  2247 heartbeater.cc:499] Master 127.29.198.62:37345 was elected leader, sending a full tablet report...
I20260812 08:01:35.454795  2186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c988be761034bffb8da8b3b5cfa20b4"
dest_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c"
 from {username='slave'} at 127.0.0.1:51126
I20260812 08:01:35.455168  2186 raft_consensus.cc:493] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:35.455322  2186 raft_consensus.cc:3060] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:35.456477  2186 raft_consensus.cc:515] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.457599  2186 leader_election.cc:290] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [CANDIDATE]: Term 1 election: Requested vote from peers 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1:34743), 1d1a425acfe94b5caea11907e4f95bda (127.29.198.2:38665)
I20260812 08:01:35.460881 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:01:35.462349  1889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c988be761034bffb8da8b3b5cfa20b4" candidate_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6e39329e3b634732b38a2ecaa221b115"
I20260812 08:01:35.462586  1889 raft_consensus.cc:3060] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:35.462939  2039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c988be761034bffb8da8b3b5cfa20b4" candidate_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1d1a425acfe94b5caea11907e4f95bda"
I20260812 08:01:35.463187  2039 raft_consensus.cc:3060] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:35.463778  1889 raft_consensus.cc:2468] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00b7cba1dbba4bd7a61f8f74896bfb4c in term 1.
I20260812 08:01:35.464253  2039 raft_consensus.cc:2468] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00b7cba1dbba4bd7a61f8f74896bfb4c in term 1.
I20260812 08:01:35.464257  2116 leader_election.cc:304] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00b7cba1dbba4bd7a61f8f74896bfb4c, 6e39329e3b634732b38a2ecaa221b115; no voters: 
I20260812 08:01:35.464571  2283 raft_consensus.cc:2804] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:35.464866  2283 raft_consensus.cc:697] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 1 LEADER]: Becoming Leader. State: Replica: 00b7cba1dbba4bd7a61f8f74896bfb4c, State: Running, Role: LEADER
I20260812 08:01:35.465236  2283 consensus_queue.cc:237] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:35.468855  1712 catalog_manager.cc:5719] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 00b7cba1dbba4bd7a61f8f74896bfb4c (127.29.198.3). New cstate: current_term: 1 leader_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } }
W20260812 08:01:35.489106  1946 tablet.cc:2406] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:35.563977 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
W20260812 08:01:35.596918  2248 tablet.cc:2406] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:35.668257  2093 tablet.cc:2406] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:35.767432 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
I20260812 08:01:35.864413  2283 consensus_queue.cc:1048] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:35.871004  2289 consensus_queue.cc:1048] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:36.071277 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 1788
W20260812 08:01:36.322304  2116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: connect: Connection refused (error 111)
W20260812 08:01:36.323238  2116 consensus_peers.cc:597] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c -> Peer 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1:34743): Couldn't send request to peer 6e39329e3b634732b38a2ecaa221b115. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:39.031966  2116 consensus_peers.cc:597] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c -> Peer 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1:34743): Couldn't send request to peer 6e39329e3b634732b38a2ecaa221b115. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 08:01:41.213330  2308 raft_consensus.cc:1012] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c: Attempting to remove follower 6e39329e3b634732b38a2ecaa221b115 from the Raft config. Reason: Leader has been unable to successfully communicate with peer 6e39329e3b634732b38a2ecaa221b115 for more than 5 seconds (5.342s)
I20260812 08:01:41.214294  2308 consensus_queue.cc:237] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } }
I20260812 08:01:41.215881  2039 raft_consensus.cc:1275] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 1 FOLLOWER]: Refusing update from remote peer 00b7cba1dbba4bd7a61f8f74896bfb4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:41.216379  2323 consensus_queue.cc:1048] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:01:41.218761  2308 raft_consensus.cc:2955] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } }
I20260812 08:01:41.219434  2039 raft_consensus.cc:2955] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } }
I20260812 08:01:41.221989  1712 catalog_manager.cc:5719] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c reported cstate change: config changed from index -1 to 2, VOTER 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1) evicted. New cstate: current_term: 1 leader_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } }
W20260812 08:01:41.225733  1697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: connect: Connection refused (error 111)
I20260812 08:01:41.226512  2186 consensus_queue.cc:237] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } }
W20260812 08:01:41.227007  1697 catalog_manager.cc:4777] TS 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1:34743): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8c988be761034bffb8da8b3b5cfa20b4: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: connect: Connection refused (error 111)
I20260812 08:01:41.228209  2039 raft_consensus.cc:1275] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 1 FOLLOWER]: Refusing update from remote peer 00b7cba1dbba4bd7a61f8f74896bfb4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260812 08:01:41.228474  2116 consensus_peers.cc:597] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c -> Peer 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1:34743): Couldn't send request to peer 6e39329e3b634732b38a2ecaa221b115. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:41.228740  2308 consensus_queue.cc:1048] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:01:41.230366  2323 raft_consensus.cc:2955] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } }
I20260812 08:01:41.230829  2039 raft_consensus.cc:2955] T 8c988be761034bffb8da8b3b5cfa20b4 P 1d1a425acfe94b5caea11907e4f95bda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } }
I20260812 08:01:41.232314  1698 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 8c988be761034bffb8da8b3b5cfa20b4 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260812 08:01:41.233086  1712 catalog_manager.cc:5719] T 8c988be761034bffb8da8b3b5cfa20b4 P 00b7cba1dbba4bd7a61f8f74896bfb4c reported cstate change: config changed from index 2 to 3, VOTER 6e39329e3b634732b38a2ecaa221b115 (127.29.198.1) added. New cstate: current_term: 1 leader_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "00b7cba1dbba4bd7a61f8f74896bfb4c" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 36239 } } peers { permanent_uuid: "1d1a425acfe94b5caea11907e4f95bda" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 38665 } } peers { permanent_uuid: "6e39329e3b634732b38a2ecaa221b115" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34743 } } }
I20260812 08:01:41.239161 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:34743
--local_ip_for_outbound_sockets=127.29.198.1
--tserver_master_addrs=127.29.198.62:37345
--webserver_port=43331
--webserver_interface=127.29.198.1
--builtin_ntp_servers=127.29.198.20:46033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 08:01:41.354598  2336 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:41.354835  2336 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:41.354857  2336 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:41.355002  2336 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:41.358596  2336 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:41.358688  2336 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:41.358817  2336 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:41.362838  2336 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:34743
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=43331
--tserver_master_addrs=127.29.198.62:37345
--never_fsync=true
--heap_profile_path=/tmp/kudu.2336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:41.363952  2336 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:41.365151  2336 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:41.372083  2343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:41.372179  2345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:41.372277  2342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:41.372169  2336 server_base.cc:1061] running on GCE node
I20260812 08:01:41.372732  2336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:41.373221  2336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:41.374418  2336 hybrid_clock.cc:648] HybridClock initialized: now 1786521701374394 us; error 32 us; skew 500 ppm
I20260812 08:01:41.376609  2336 webserver.cc:533] Webserver started at http://127.29.198.1:43331/ using document root <none> and password file <none>
I20260812 08:01:41.377177  2336 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:41.377256  2336 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:41.381208  2336 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:41.383394  2352 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:41.384624  2336 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:41.384732  2336 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "6e39329e3b634732b38a2ecaa221b115"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-1zqn"
I20260812 08:01:41.385185  2336 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:41.396780  2336 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:41.397358  2336 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:41.397522  2336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:41.398036  2336 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:41.399309  2359 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:01:41.402716  2336 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:01:41.402808  2336 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:01:41.402900  2336 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:01:41.404542  2336 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:01:41.404618  2336 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:41.404937  2359 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Bootstrap starting.
I20260812 08:01:41.417759  2336 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:34743
I20260812 08:01:41.417857  2486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:34743 every 8 connection(s)
I20260812 08:01:41.418955  2336 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:41.423426  2359 log.cc:826] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:41.426901  2359 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:41.427415  2359 tablet_bootstrap.cc:492] T 8c988be761034bffb8da8b3b5cfa20b4 P 6e39329e3b634732b38a2ecaa221b115: Bootstrap complete.
I20260812 08:01:41.427410 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 2336
I20260812 08:01:41.428421 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 2336
I20260812 08:01:41.440366 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 1949
W20260812 08:01:41.440934  2334 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:41.423031 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.29.198.1:34743 (local address 127.0.0.1:54962)
0812 08:01:41.423215 (+   184us) negotiation.cc:107] Waiting for socket to connect
0812 08:01:41.423227 (+    12us) client_negotiation.cc:175] Beginning negotiation
0812 08:01:41.423354 (+   127us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:01:41.424258 (+   904us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0812 08:01:41.424261 (+     3us) client_negotiation.cc:404] Received NEGOTIATE response from server
0812 08:01:41.424318 (+    57us) client_negotiation.cc:190] Negotiated authn=SASL
0812 08:01:41.424586 (+   268us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0812 08:01:41.424594 (+     8us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0812 08:01:41.426073 (+  1479us) client_negotiation.cc:281] Received TLS_HANDSHAKE NegotiatePB response
0812 08:01:41.426078 (+     5us) client_negotiation.cc:543] Received TLS_HANDSHAKE response from server
0812 08:01:41.426472 (+   394us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0812 08:01:41.426481 (+     9us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0812 08:01:41.426642 (+   161us) client_negotiation.cc:564] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0812 08:01:41.434399 (+  7757us) client_negotiation.cc:639] Initiating SASL PLAIN handshake
0812 08:01:41.434401 (+     2us) client_negotiation.cc:672] calling sasl_client_start()
0812 08:01:41.434424 (+    23us) client_negotiation.cc:830] callback for SASL_CB_AUTHNAME
0812 08:01:41.434493 (+    69us) client_negotiation.cc:262] Sending SASL_INITIATE NegotiatePB request
0812 08:01:41.440215 (+  5722us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34743: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":120}
W20260812 08:01:41.446133  2489 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:41.421404 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.29.198.1:42617 (local address 127.29.198.62:37345)
0812 08:01:41.421822 (+   418us) server_negotiation.cc:207] Beginning negotiation
0812 08:01:41.421828 (+     6us) server_negotiation.cc:400] Waiting for connection header
0812 08:01:41.422503 (+   675us) server_negotiation.cc:408] Connection header received
0812 08:01:41.423643 (+  1140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 08:01:41.423647 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 08:01:41.423703 (+    56us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 08:01:41.423775 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
0812 08:01:41.424910 (+  1135us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0812 08:01:41.425788 (+   878us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0812 08:01:41.426776 (+   988us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0812 08:01:41.427031 (+   255us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
0812 08:01:41.440254 (+ 13223us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.198.1:42617: BlockingRecv error: recv got EOF from 127.29.198.1:42617 (error 108)
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":148,"threads_started":1}
I20260812 08:01:41.452126 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 2095
I20260812 08:01:41.461262 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 1674
2026-08-12T08:01:41Z chronyd exiting
[       OK ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/0 (6909 ms)
[ RUN      ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/1
2026-08-12T08:01:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:41Z Disabled control of system clock
I20260812 08:01:41.498842 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:39095
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:39095
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--raft_prepare_replacement_before_eviction=true with env {}
W20260812 08:01:41.609333  2498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:41.609572  2498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:41.609613  2498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:41.612970  2498 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:41.613034  2498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:41.613055  2498 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:41.613072  2498 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:41.616916  2498 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:39095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:39095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:41.617980  2498 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:41.619079  2498 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:41.624760  2510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:41.624766  2503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:41.624817  2505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:41.625182  2498 server_base.cc:1061] running on GCE node
I20260812 08:01:41.625639  2498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:41.626554  2498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:41.627700  2498 hybrid_clock.cc:648] HybridClock initialized: now 1786521701627678 us; error 34 us; skew 500 ppm
I20260812 08:01:41.629544  2498 webserver.cc:533] Webserver started at http://127.29.198.62:39467/ using document root <none> and password file <none>
I20260812 08:01:41.630100  2498 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:41.630156  2498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:41.630399  2498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:41.631987  2498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86"
format_stamp: "Formatted at 2026-08-12 08:01:41 on dist-test-slave-1zqn"
I20260812 08:01:41.632539  2498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86"
format_stamp: "Formatted at 2026-08-12 08:01:41 on dist-test-slave-1zqn"
I20260812 08:01:41.635948  2498 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:41.638127  2516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:41.639122  2498 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:41.639268  2498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86"
format_stamp: "Formatted at 2026-08-12 08:01:41 on dist-test-slave-1zqn"
I20260812 08:01:41.639374  2498 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:41.651886  2498 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:41.652645  2498 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:41.652844  2498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:41.660714  2498 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:39095
I20260812 08:01:41.660718  2574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:39095 every 8 connection(s)
I20260812 08:01:41.661754  2498 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:41.664526 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 2498
I20260812 08:01:41.664674 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:41.664793  2575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:41.669925  2575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86: Bootstrap starting.
I20260812 08:01:41.672259  2575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:41.673067  2575 log.cc:826] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:41.674806  2575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86: No bootstrap required, opened a new log
I20260812 08:01:41.677495  2575 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 39095 } }
I20260812 08:01:41.677677  2575 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:41.677721  2575 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ea2187e5c4c3496ce03fa9ee96f86, State: Initialized, Role: FOLLOWER
I20260812 08:01:41.678097  2575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 39095 } }
I20260812 08:01:41.678246  2575 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:41.678314  2575 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:41.678474  2575 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:41.679407  2575 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 39095 } }
I20260812 08:01:41.679701  2575 leader_election.cc:304] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b0ea2187e5c4c3496ce03fa9ee96f86; no voters: 
I20260812 08:01:41.679949  2575 leader_election.cc:290] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:41.680114  2581 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:41.680389  2581 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0ea2187e5c4c3496ce03fa9ee96f86, State: Running, Role: LEADER
I20260812 08:01:41.680747  2581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 39095 } }
I20260812 08:01:41.681141  2575 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:41.682559  2582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 39095 } } }
I20260812 08:01:41.682586  2583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b0ea2187e5c4c3496ce03fa9ee96f86. Latest consensus state: current_term: 1 leader_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0ea2187e5c4c3496ce03fa9ee96f86" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 39095 } } }
I20260812 08:01:41.682680  2582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:41.682691  2583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:41.683269  2591 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:41.686317  2591 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:41.691535  2591 catalog_manager.cc:1383] Generated new cluster ID: cef2a951a776462fb5445e19879caf59
I20260812 08:01:41.691612  2591 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:41.717798  2591 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:41.719008  2591 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:41.732682  2591 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 5b0ea2187e5c4c3496ce03fa9ee96f86: Generated new TSK 0
I20260812 08:01:41.733389  2591 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:41.744771 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--builtin_ntp_servers=127.29.198.20:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
W20260812 08:01:41.853865  2603 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:41.854108  2603 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:41.854131  2603 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:41.854223  2603 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:41.857728  2603 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:41.857841  2603 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:41.861804  2603 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--never_fsync=true
--heap_profile_path=/tmp/kudu.2603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:41.862877  2603 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:41.864037  2603 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:41.870483  2615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:41.870483  2612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:41.870514  2610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:41.871186  2603 server_base.cc:1061] running on GCE node
I20260812 08:01:41.871519  2603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:41.872103  2603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:41.873353  2603 hybrid_clock.cc:648] HybridClock initialized: now 1786521701873329 us; error 37 us; skew 500 ppm
I20260812 08:01:41.875317  2603 webserver.cc:533] Webserver started at http://127.29.198.1:40041/ using document root <none> and password file <none>
I20260812 08:01:41.875941  2603 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:41.876005  2603 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:41.876292  2603 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:41.878010  2603 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "fd7e60ac99e4426082d4f3bbea116134"
format_stamp: "Formatted at 2026-08-12 08:01:41 on dist-test-slave-1zqn"
I20260812 08:01:41.878541  2603 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "fd7e60ac99e4426082d4f3bbea116134"
format_stamp: "Formatted at 2026-08-12 08:01:41 on dist-test-slave-1zqn"
I20260812 08:01:41.882321  2603 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:41.884902  2622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:41.886094  2603 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:41.886235  2603 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "fd7e60ac99e4426082d4f3bbea116134"
format_stamp: "Formatted at 2026-08-12 08:01:41 on dist-test-slave-1zqn"
I20260812 08:01:41.886348  2603 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:41.900794  2603 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:41.901624  2603 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:41.901844  2603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:41.902482  2603 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:41.903553  2603 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:41.903607  2603 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:41.903653  2603 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:41.903720  2603 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:41.914198  2603 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:37551
I20260812 08:01:41.914290  2761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:37551 every 8 connection(s)
I20260812 08:01:41.915307  2603 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:41.922091 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 2603
I20260812 08:01:41.922224 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:41.924702 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--builtin_ntp_servers=127.29.198.20:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
I20260812 08:01:41.924980  2762 heartbeater.cc:344] Connected to a master server at 127.29.198.62:39095
I20260812 08:01:41.925246  2762 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:41.925770  2762 heartbeater.cc:507] Master 127.29.198.62:39095 requested a full tablet report, sending...
I20260812 08:01:41.927336  2534 ts_manager.cc:194] Registered new tserver with Master: fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1:37551)
I20260812 08:01:41.928661  2534 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:41315
W20260812 08:01:42.032505  2765 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:42.032714  2765 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:42.032737  2765 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:42.032853  2765 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:42.036162  2765 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:42.036303  2765 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:42.040128  2765 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--never_fsync=true
--heap_profile_path=/tmp/kudu.2765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:42.041364  2765 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:42.042522  2765 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:42.049441  2773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:42.049399  2770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:42.049503  2765 server_base.cc:1061] running on GCE node
W20260812 08:01:42.049417  2771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:42.050014  2765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:42.050578  2765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:42.051745  2765 hybrid_clock.cc:648] HybridClock initialized: now 1786521702051725 us; error 32 us; skew 500 ppm
I20260812 08:01:42.053550  2765 webserver.cc:533] Webserver started at http://127.29.198.2:46453/ using document root <none> and password file <none>
I20260812 08:01:42.054157  2765 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:42.054217  2765 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:42.054436  2765 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:42.055984  2765 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "20568b610252471ba4b6b08501a1f885"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.056529  2765 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "20568b610252471ba4b6b08501a1f885"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.059762  2765 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:42.062117  2782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.063177  2765 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:42.063320  2765 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "20568b610252471ba4b6b08501a1f885"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.063424  2765 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:42.081679  2765 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:42.082402  2765 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:42.082616  2765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:42.083276  2765 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:42.084408  2765 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:42.084486  2765 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.084559  2765 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:42.084616  2765 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.095191  2765 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:44777
I20260812 08:01:42.095249  2915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:44777 every 8 connection(s)
I20260812 08:01:42.096295  2765 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:42.102087 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 2765
I20260812 08:01:42.102205 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:42.104682 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--builtin_ntp_servers=127.29.198.20:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
I20260812 08:01:42.106850  2916 heartbeater.cc:344] Connected to a master server at 127.29.198.62:39095
I20260812 08:01:42.107113  2916 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:42.107650  2916 heartbeater.cc:507] Master 127.29.198.62:39095 requested a full tablet report, sending...
I20260812 08:01:42.108821  2534 ts_manager.cc:194] Registered new tserver with Master: 20568b610252471ba4b6b08501a1f885 (127.29.198.2:44777)
I20260812 08:01:42.109579  2534 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:51695
W20260812 08:01:42.213248  2919 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:42.213516  2919 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:42.213581  2919 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:42.213697  2919 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:42.216979  2919 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:42.217142  2919 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:42.220974  2919 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--never_fsync=true
--heap_profile_path=/tmp/kudu.2919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:42.222081  2919 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:42.223191  2919 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:42.230195  2927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:42.230206  2924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:42.230211  2925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:42.230408  2919 server_base.cc:1061] running on GCE node
I20260812 08:01:42.230887  2919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:42.231448  2919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:42.232645  2919 hybrid_clock.cc:648] HybridClock initialized: now 1786521702232632 us; error 29 us; skew 500 ppm
I20260812 08:01:42.234414  2919 webserver.cc:533] Webserver started at http://127.29.198.3:39491/ using document root <none> and password file <none>
I20260812 08:01:42.234977  2919 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:42.235060  2919 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:42.235287  2919 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:42.236897  2919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.237393  2919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.240859  2919 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:42.245370  2934 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.246850  2919 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:01:42.246978  2919 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.247095  2919 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:42.262300  2919 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:42.262982  2919 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:42.263183  2919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:42.263773  2919 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:42.264851  2919 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:42.264901  2919 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.264941  2919 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:42.264956  2919 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.274907  2919 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:46735
I20260812 08:01:42.274940  3063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:46735 every 8 connection(s)
I20260812 08:01:42.275904  2919 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:42.282087 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 2919
I20260812 08:01:42.282193 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:42.284880 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.4:0
--local_ip_for_outbound_sockets=127.29.198.4
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--builtin_ntp_servers=127.29.198.20:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
I20260812 08:01:42.285522  3064 heartbeater.cc:344] Connected to a master server at 127.29.198.62:39095
I20260812 08:01:42.285787  3064 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:42.286383  3064 heartbeater.cc:507] Master 127.29.198.62:39095 requested a full tablet report, sending...
I20260812 08:01:42.287670  2534 ts_manager.cc:194] Registered new tserver with Master: eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735)
I20260812 08:01:42.288450  2534 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:37319
W20260812 08:01:42.391167  3067 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:42.391499  3067 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:42.391528  3067 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:42.391637  3067 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:42.394979  3067 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:42.395112  3067 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.4
I20260812 08:01:42.398901  3067 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:39095
--never_fsync=true
--heap_profile_path=/tmp/kudu.3067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:42.399995  3067 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:42.401167  3067 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:42.408281  3072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:42.408257  3073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:42.408284  3075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:42.408516  3067 server_base.cc:1061] running on GCE node
I20260812 08:01:42.408854  3067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:42.409373  3067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:42.410566  3067 hybrid_clock.cc:648] HybridClock initialized: now 1786521702410552 us; error 32 us; skew 500 ppm
I20260812 08:01:42.412426  3067 webserver.cc:533] Webserver started at http://127.29.198.4:37877/ using document root <none> and password file <none>
I20260812 08:01:42.413003  3067 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:42.413096  3067 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:42.413354  3067 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:42.414924  3067 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data/instance:
uuid: "bc723373c03d45368977bd6bf35c537a"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.415412  3067 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance:
uuid: "bc723373c03d45368977bd6bf35c537a"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.419021  3067 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:01:42.421278  3085 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.422303  3067 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:42.422433  3067 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
uuid: "bc723373c03d45368977bd6bf35c537a"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:42.422564  3067 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:42.437264  3067 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:42.437992  3067 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:42.438194  3067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:42.438783  3067 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:42.439823  3067 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:42.439898  3067 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.439965  3067 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:42.440011  3067 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:42.450256  3067 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.4:43409
I20260812 08:01:42.450294  3220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.4:43409 every 8 connection(s)
I20260812 08:01:42.451243  3067 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
I20260812 08:01:42.452386 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 3067
I20260812 08:01:42.452482 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance
I20260812 08:01:42.461140  3222 heartbeater.cc:344] Connected to a master server at 127.29.198.62:39095
I20260812 08:01:42.461423  3222 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:42.462049  3222 heartbeater.cc:507] Master 127.29.198.62:39095 requested a full tablet report, sending...
I20260812 08:01:42.463310  2534 ts_manager.cc:194] Registered new tserver with Master: bc723373c03d45368977bd6bf35c537a (127.29.198.4:43409)
I20260812 08:01:42.464272  2534 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.4:49797
I20260812 08:01:42.467371 30488 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 08:01:42.487423  2534 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46128:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:01:42.505853  2989 tablet_service.cc:1511] Processing CreateTablet for tablet 34d8294049c846f181584faa20d6de36 (DEFAULT_TABLE table=test-workload [id=ea208a063b704d66aa482bdd5b7f6210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:42.505862  2838 tablet_service.cc:1511] Processing CreateTablet for tablet 34d8294049c846f181584faa20d6de36 (DEFAULT_TABLE table=test-workload [id=ea208a063b704d66aa482bdd5b7f6210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:42.505860  3140 tablet_service.cc:1511] Processing CreateTablet for tablet 34d8294049c846f181584faa20d6de36 (DEFAULT_TABLE table=test-workload [id=ea208a063b704d66aa482bdd5b7f6210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:42.506795  2989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d8294049c846f181584faa20d6de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:42.506804  2838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d8294049c846f181584faa20d6de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:42.506804  3140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d8294049c846f181584faa20d6de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:42.511927  3248 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Bootstrap starting.
I20260812 08:01:42.513037  3249 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: Bootstrap starting.
I20260812 08:01:42.513055  3250 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Bootstrap starting.
I20260812 08:01:42.514562  3248 tablet_bootstrap.cc:654] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:42.515157  3250 tablet_bootstrap.cc:654] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:42.515157  3249 tablet_bootstrap.cc:654] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:42.515377  3248 log.cc:826] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:42.515944  3250 log.cc:826] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:42.515942  3249 log.cc:826] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:42.517215  3248 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: No bootstrap required, opened a new log
I20260812 08:01:42.517444  3248 ts_tablet_manager.cc:1403] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:42.517689  3250 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: No bootstrap required, opened a new log
I20260812 08:01:42.517866  3250 ts_tablet_manager.cc:1403] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:42.517913  3249 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: No bootstrap required, opened a new log
I20260812 08:01:42.518064  3249 ts_tablet_manager.cc:1403] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:42.520447  3248 raft_consensus.cc:359] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.520660  3248 raft_consensus.cc:740] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9e6ccb7e8a4c0c83d0a1ac731b9a66, State: Initialized, Role: FOLLOWER
I20260812 08:01:42.520892  3250 raft_consensus.cc:359] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.520892  3249 raft_consensus.cc:359] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.520978  3248 consensus_queue.cc:260] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.521101  3249 raft_consensus.cc:740] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc723373c03d45368977bd6bf35c537a, State: Initialized, Role: FOLLOWER
I20260812 08:01:42.521101  3250 raft_consensus.cc:740] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20568b610252471ba4b6b08501a1f885, State: Initialized, Role: FOLLOWER
I20260812 08:01:42.521390  3250 consensus_queue.cc:260] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.521390  3249 consensus_queue.cc:260] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.521766  3064 heartbeater.cc:499] Master 127.29.198.62:39095 was elected leader, sending a full tablet report...
I20260812 08:01:42.522065  3248 ts_tablet_manager.cc:1434] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:42.522241  3249 ts_tablet_manager.cc:1434] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:42.522555  3222 heartbeater.cc:499] Master 127.29.198.62:39095 was elected leader, sending a full tablet report...
I20260812 08:01:42.522701  3250 ts_tablet_manager.cc:1434] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:42.522836  2916 heartbeater.cc:499] Master 127.29.198.62:39095 was elected leader, sending a full tablet report...
W20260812 08:01:42.527118  3065 tablet.cc:2406] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:42.561539  2864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34d8294049c846f181584faa20d6de36"
dest_uuid: "20568b610252471ba4b6b08501a1f885"
 from {username='slave'} at 127.0.0.1:56128
I20260812 08:01:42.561843  2864 raft_consensus.cc:493] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:42.562007  2864 raft_consensus.cc:3060] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:42.563164  2864 raft_consensus.cc:515] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.564567  2864 leader_election.cc:290] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [CANDIDATE]: Term 1 election: Requested vote from peers bc723373c03d45368977bd6bf35c537a (127.29.198.4:43409), eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735)
I20260812 08:01:42.568782 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:01:42.568779  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d8294049c846f181584faa20d6de36" candidate_uuid: "20568b610252471ba4b6b08501a1f885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bc723373c03d45368977bd6bf35c537a"
I20260812 08:01:42.569026  3161 raft_consensus.cc:3060] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:42.570043  3161 raft_consensus.cc:2468] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20568b610252471ba4b6b08501a1f885 in term 1.
I20260812 08:01:42.570495  2786 leader_election.cc:304] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20568b610252471ba4b6b08501a1f885, bc723373c03d45368977bd6bf35c537a; no voters: 
I20260812 08:01:42.570741  3010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d8294049c846f181584faa20d6de36" candidate_uuid: "20568b610252471ba4b6b08501a1f885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66"
I20260812 08:01:42.570789  3259 raft_consensus.cc:2804] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:42.570957  3010 raft_consensus.cc:3060] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:42.571128  3259 raft_consensus.cc:697] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 1 LEADER]: Becoming Leader. State: Replica: 20568b610252471ba4b6b08501a1f885, State: Running, Role: LEADER
I20260812 08:01:42.571456  3259 consensus_queue.cc:237] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:42.571993  3010 raft_consensus.cc:2468] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20568b610252471ba4b6b08501a1f885 in term 1.
I20260812 08:01:42.574983  2531 catalog_manager.cc:5719] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20568b610252471ba4b6b08501a1f885 (127.29.198.2). New cstate: current_term: 1 leader_uuid: "20568b610252471ba4b6b08501a1f885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } health_report { overall_health: HEALTHY } } }
W20260812 08:01:42.597559  2917 tablet.cc:2406] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:42.672225 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
W20260812 08:01:42.702306  3223 tablet.cc:2406] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:42.875419 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0 0.0
I20260812 08:01:42.930872  2762 heartbeater.cc:499] Master 127.29.198.62:39095 was elected leader, sending a full tablet report...
I20260812 08:01:43.126327  3266 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:43.133065  3272 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:43.178953 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 2919
W20260812 08:01:43.554481  2784 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111)
W20260812 08:01:43.555603  2784 consensus_peers.cc:597] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 -> Peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735): Couldn't send request to peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:46.161525  2784 consensus_peers.cc:597] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 -> Peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735): Couldn't send request to peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 08:01:48.201984  3287 consensus_queue.cc:579] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Leader has been unable to successfully communicate with peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66 for more than 5 seconds (5.070s)
I20260812 08:01:48.205690  2864 consensus_queue.cc:237] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: true } }
I20260812 08:01:48.207651  3161 raft_consensus.cc:1275] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Refusing update from remote peer 20568b610252471ba4b6b08501a1f885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:48.208534  3291 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 08:01:48.208739  2784 consensus_peers.cc:597] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 -> Peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735): Couldn't send request to peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:48.210847  3290 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: true } } }
I20260812 08:01:48.211489  3161 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: true } } }
I20260812 08:01:48.213032  2519 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 34d8294049c846f181584faa20d6de36 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20260812 08:01:48.213614  2783 consensus_peers.cc:597] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 -> Peer fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1:37551): Couldn't send request to peer fd7e60ac99e4426082d4f3bbea116134. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34d8294049c846f181584faa20d6de36. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:48.214116  2534 catalog_manager.cc:5719] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 reported cstate change: config changed from index -1 to 2, NON_VOTER fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) added. New cstate: current_term: 1 leader_uuid: "20568b610252471ba4b6b08501a1f885" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260812 08:01:48.601132  2784 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260812 08:01:48.831425  3304 ts_tablet_manager.cc:933] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Initiating tablet copy from peer 20568b610252471ba4b6b08501a1f885 (127.29.198.2:44777)
I20260812 08:01:48.832222  3304 tablet_copy_client.cc:323] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: tablet copy: Beginning tablet copy session from remote peer at address 127.29.198.2:44777
I20260812 08:01:48.836872  2888 tablet_copy_service.cc:140] P 20568b610252471ba4b6b08501a1f885: Received BeginTabletCopySession request for tablet 34d8294049c846f181584faa20d6de36 from peer fd7e60ac99e4426082d4f3bbea116134 ({username='slave'} at 127.29.198.1:60641)
I20260812 08:01:48.837007  2888 tablet_copy_service.cc:161] P 20568b610252471ba4b6b08501a1f885: Beginning new tablet copy session on tablet 34d8294049c846f181584faa20d6de36 from peer fd7e60ac99e4426082d4f3bbea116134 at {username='slave'} at 127.29.198.1:60641: session id = fd7e60ac99e4426082d4f3bbea116134-34d8294049c846f181584faa20d6de36
I20260812 08:01:48.838251  2888 tablet_copy_source_session.cc:215] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:01:48.841811  3304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d8294049c846f181584faa20d6de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:48.847036  3304 tablet_copy_client.cc:806] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: tablet copy: Starting download of 0 data blocks...
I20260812 08:01:48.847251  3304 tablet_copy_client.cc:670] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: tablet copy: Starting download of 1 WAL segments...
I20260812 08:01:48.849157  3304 tablet_copy_client.cc:538] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:01:48.850577  3304 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Bootstrap starting.
I20260812 08:01:48.854808  3304 log.cc:826] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:48.857841  3304 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:48.858093  3304 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Bootstrap complete.
I20260812 08:01:48.858333  3304 ts_tablet_manager.cc:1403] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Time spent bootstrapping tablet: real 0.008s	user 0.006s	sys 0.001s
I20260812 08:01:48.860745  3304 raft_consensus.cc:359] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: true } }
I20260812 08:01:48.860946  3304 raft_consensus.cc:740] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fd7e60ac99e4426082d4f3bbea116134, State: Initialized, Role: LEARNER
I20260812 08:01:48.861227  3304 consensus_queue.cc:260] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: true } }
I20260812 08:01:48.861923  3304 ts_tablet_manager.cc:1434] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:48.862661  2888 tablet_copy_service.cc:342] P 20568b610252471ba4b6b08501a1f885: Request end of tablet copy session fd7e60ac99e4426082d4f3bbea116134-34d8294049c846f181584faa20d6de36 received from {username='slave'} at 127.29.198.1:60641
I20260812 08:01:48.862754  2888 tablet_copy_service.cc:434] P 20568b610252471ba4b6b08501a1f885: ending tablet copy session fd7e60ac99e4426082d4f3bbea116134-34d8294049c846f181584faa20d6de36 on tablet 34d8294049c846f181584faa20d6de36 with peer fd7e60ac99e4426082d4f3bbea116134
I20260812 08:01:49.252445  2704 raft_consensus.cc:1217] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 08:01:49.859972  3315 raft_consensus.cc:1064] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885: attempting to promote NON_VOTER fd7e60ac99e4426082d4f3bbea116134 to VOTER
I20260812 08:01:49.860585  3315 consensus_queue.cc:237] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } }
I20260812 08:01:49.862453  2704 raft_consensus.cc:1275] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 LEARNER]: Refusing update from remote peer 20568b610252471ba4b6b08501a1f885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:01:49.862644  3161 raft_consensus.cc:1275] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Refusing update from remote peer 20568b610252471ba4b6b08501a1f885: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260812 08:01:49.863051  2784 consensus_peers.cc:597] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 -> Peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735): Couldn't send request to peer eb9e6ccb7e8a4c0c83d0a1ac731b9a66. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:49.863137  3315 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:01:49.863297  3316 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:01:49.865931  3315 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
I20260812 08:01:49.866562  2704 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
I20260812 08:01:49.868144  3161 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
I20260812 08:01:49.868839  2531 catalog_manager.cc:5719] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 reported cstate change: config changed from index 2 to 3, fd7e60ac99e4426082d4f3bbea116134 (127.29.198.1) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "20568b610252471ba4b6b08501a1f885" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260812 08:01:49.872879  2864 consensus_queue.cc:237] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } }
I20260812 08:01:49.874096  2704 raft_consensus.cc:1275] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 FOLLOWER]: Refusing update from remote peer 20568b610252471ba4b6b08501a1f885: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 08:01:49.874480  3316 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:01:49.874540  3161 raft_consensus.cc:1275] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Refusing update from remote peer 20568b610252471ba4b6b08501a1f885: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260812 08:01:49.874886  3316 consensus_queue.cc:1048] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:01:49.876127  3320 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P 20568b610252471ba4b6b08501a1f885 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
I20260812 08:01:49.876818  3161 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
I20260812 08:01:49.877599  2519 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet 34d8294049c846f181584faa20d6de36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 08:01:49.877822  2704 raft_consensus.cc:2955] T 34d8294049c846f181584faa20d6de36 P fd7e60ac99e4426082d4f3bbea116134 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
I20260812 08:01:49.879249  2532 catalog_manager.cc:5719] T 34d8294049c846f181584faa20d6de36 P bc723373c03d45368977bd6bf35c537a reported cstate change: config changed from index 3 to 4, VOTER eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3) evicted. New cstate: current_term: 1 leader_uuid: "20568b610252471ba4b6b08501a1f885" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } } peers { permanent_uuid: "fd7e60ac99e4426082d4f3bbea116134" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 37551 } attrs { promote: false } } }
W20260812 08:01:49.882274  2518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111)
W20260812 08:01:49.883198  2518 catalog_manager.cc:4777] TS eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 34d8294049c846f181584faa20d6de36: Network error: Client connection negotiation failed: client connection to 127.29.198.3:46735: connect: Connection refused (error 111)
I20260812 08:01:49.885665 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:46735
--local_ip_for_outbound_sockets=127.29.198.3
--tserver_master_addrs=127.29.198.62:39095
--webserver_port=39491
--webserver_interface=127.29.198.3
--builtin_ntp_servers=127.29.198.20:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--follower_unavailable_considered_failed_sec=5
--raft_prepare_replacement_before_eviction=true with env {}
W20260812 08:01:49.994395  3332 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:49.994678  3332 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:49.994745  3332 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:49.994843  3332 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:49.998409  3332 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:49.998592  3332 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:50.002578  3332 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=5
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:46735
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=39491
--tserver_master_addrs=127.29.198.62:39095
--never_fsync=true
--heap_profile_path=/tmp/kudu.3332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:50.003791  3332 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:50.005059  3332 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:50.012235  3332 server_base.cc:1061] running on GCE node
W20260812 08:01:50.012267  3339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.012320  3338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.012279  3341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.012943  3332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:50.013571  3332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:50.014753  3332 hybrid_clock.cc:648] HybridClock initialized: now 1786521710014742 us; error 37 us; skew 500 ppm
I20260812 08:01:50.016696  3332 webserver.cc:533] Webserver started at http://127.29.198.3:39491/ using document root <none> and password file <none>
I20260812 08:01:50.017293  3332 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:50.017396  3332 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:50.020946  3332 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:50.023001  3347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.024237  3332 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:50.024366  3332 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66"
format_stamp: "Formatted at 2026-08-12 08:01:42 on dist-test-slave-1zqn"
I20260812 08:01:50.024765  3332 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:50.035686  3332 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:50.036371  3332 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:50.036564  3332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:50.037158  3332 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:50.038403  3355 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:01:50.042528  3332 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:01:50.042613  3332 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:01:50.042708  3332 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:01:50.044281  3332 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:01:50.044346  3332 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:50.044641  3355 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Bootstrap starting.
I20260812 08:01:50.056444  3332 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:46735
I20260812 08:01:50.056468  3489 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:46735 every 8 connection(s)
I20260812 08:01:50.057525  3332 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:50.060909  3355 log.cc:826] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:50.062831 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 3332
I20260812 08:01:50.063377 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 2603
I20260812 08:01:50.067286  3355 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:50.067919  3355 tablet_bootstrap.cc:492] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Bootstrap complete.
I20260812 08:01:50.069725  3355 ts_tablet_manager.cc:1403] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260812 08:01:50.072515  3492 heartbeater.cc:344] Connected to a master server at 127.29.198.62:39095
I20260812 08:01:50.072741  3492 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:50.073228  3492 heartbeater.cc:507] Master 127.29.198.62:39095 requested a full tablet report, sending...
I20260812 08:01:50.074958  2531 ts_manager.cc:194] Re-registered known tserver with Master: eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735)
I20260812 08:01:50.074815  3355 raft_consensus.cc:359] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:50.075389  3355 raft_consensus.cc:740] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9e6ccb7e8a4c0c83d0a1ac731b9a66, State: Initialized, Role: FOLLOWER
I20260812 08:01:50.075752  2531 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:56881
I20260812 08:01:50.075820  3355 consensus_queue.cc:260] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc723373c03d45368977bd6bf35c537a" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 43409 } } peers { permanent_uuid: "eb9e6ccb7e8a4c0c83d0a1ac731b9a66" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 46735 } } peers { permanent_uuid: "20568b610252471ba4b6b08501a1f885" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 44777 } }
I20260812 08:01:50.077190  3355 ts_tablet_manager.cc:1434] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 08:01:50.077569  3492 heartbeater.cc:499] Master 127.29.198.62:39095 was elected leader, sending a full tablet report...
I20260812 08:01:50.084931  3407 tablet_service.cc:1558] Processing DeleteTablet for tablet 34d8294049c846f181584faa20d6de36 with delete_type TABLET_DATA_TOMBSTONED (TS eb9e6ccb7e8a4c0c83d0a1ac731b9a66 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37896
I20260812 08:01:50.085763  3499 tablet_replica.cc:333] stopping tablet replica
I20260812 08:01:50.086059  3499 raft_consensus.cc:2243] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:01:50.086304  3499 raft_consensus.cc:2272] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:01:50.087015 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 2765
I20260812 08:01:50.092195  3499 ts_tablet_manager.cc:1916] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:01:50.097254  3499 ts_tablet_manager.cc:1929] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:01:50.097390  3499 log.cc:1199] T 34d8294049c846f181584faa20d6de36 P eb9e6ccb7e8a4c0c83d0a1ac731b9a66: Deleting WAL directory at /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.EvictAndReplaceDeadFollowerITest.UnreachableFollower_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/wals/34d8294049c846f181584faa20d6de36
I20260812 08:01:50.098664  2518 catalog_manager.cc:5050] TS eb9e6ccb7e8a4c0c83d0a1ac731b9a66 (127.29.198.3:46735): tablet 34d8294049c846f181584faa20d6de36 (table test-workload [id=ea208a063b704d66aa482bdd5b7f6210]) successfully deleted
I20260812 08:01:50.099416 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 3332
I20260812 08:01:50.110035 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 3067
I20260812 08:01:50.119716 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 2498
2026-08-12T08:01:50Z chronyd exiting
[       OK ] EvictAndReplaceDeadFollowerITest.UnreachableFollower/1 (8656 ms)
[----------] 2 tests from EvictAndReplaceDeadFollowerITest (15566 ms total)

[----------] 4 tests from DontEvictIfRemainingConfigIsUnstableITest
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/0
2026-08-12T08:01:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:50Z Disabled control of system clock
I20260812 08:01:50.155431 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:41005
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:41005
--raft_prepare_replacement_before_eviction=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:01:50.264629  3504 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:50.264866  3504 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:50.264905  3504 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:50.268173  3504 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:50.268236  3504 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:50.268256  3504 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:50.268275  3504 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:50.268293  3504 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:50.272275  3504 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:41005
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:41005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.3504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:50.273351  3504 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:50.274441  3504 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:50.280280  3513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.280290  3510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.280413  3504 server_base.cc:1061] running on GCE node
W20260812 08:01:50.280340  3511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.281071  3504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:50.281883  3504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:50.283054  3504 hybrid_clock.cc:648] HybridClock initialized: now 1786521710283035 us; error 30 us; skew 500 ppm
I20260812 08:01:50.284904  3504 webserver.cc:533] Webserver started at http://127.29.198.62:46515/ using document root <none> and password file <none>
I20260812 08:01:50.285501  3504 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:50.285558  3504 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:50.285800  3504 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:50.287317  3504 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "f9e205cec89649ddb9ed7d298ffe758b"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.287799  3504 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "f9e205cec89649ddb9ed7d298ffe758b"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.291052  3504 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:50.293319  3521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.294390  3504 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:50.294572  3504 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "f9e205cec89649ddb9ed7d298ffe758b"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.294672  3504 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:50.310467  3504 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:50.311149  3504 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:50.311347  3504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:50.318583  3504 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:41005
I20260812 08:01:50.318611  3590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:41005 every 8 connection(s)
I20260812 08:01:50.319603  3504 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:50.321028 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 3504
I20260812 08:01:50.321146 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:01:50.323098  3591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:50.328346  3591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b: Bootstrap starting.
I20260812 08:01:50.330518  3591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:50.331337  3591 log.cc:826] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:50.333154  3591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b: No bootstrap required, opened a new log
I20260812 08:01:50.335784  3591 raft_consensus.cc:359] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e205cec89649ddb9ed7d298ffe758b" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41005 } }
I20260812 08:01:50.336035  3591 raft_consensus.cc:385] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:50.336126  3591 raft_consensus.cc:740] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e205cec89649ddb9ed7d298ffe758b, State: Initialized, Role: FOLLOWER
I20260812 08:01:50.336483  3591 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e205cec89649ddb9ed7d298ffe758b" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41005 } }
I20260812 08:01:50.336593  3591 raft_consensus.cc:399] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:50.336635  3591 raft_consensus.cc:493] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:50.336709  3591 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:50.337437  3591 raft_consensus.cc:515] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e205cec89649ddb9ed7d298ffe758b" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41005 } }
I20260812 08:01:50.337723  3591 leader_election.cc:304] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9e205cec89649ddb9ed7d298ffe758b; no voters: 
I20260812 08:01:50.337963  3591 leader_election.cc:290] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:50.338124  3596 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:50.338362  3596 raft_consensus.cc:697] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [term 1 LEADER]: Becoming Leader. State: Replica: f9e205cec89649ddb9ed7d298ffe758b, State: Running, Role: LEADER
I20260812 08:01:50.338701  3596 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e205cec89649ddb9ed7d298ffe758b" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41005 } }
I20260812 08:01:50.339175  3591 sys_catalog.cc:565] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:50.340509  3598 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9e205cec89649ddb9ed7d298ffe758b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e205cec89649ddb9ed7d298ffe758b" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41005 } } }
I20260812 08:01:50.340512  3597 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9e205cec89649ddb9ed7d298ffe758b. Latest consensus state: current_term: 1 leader_uuid: "f9e205cec89649ddb9ed7d298ffe758b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9e205cec89649ddb9ed7d298ffe758b" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 41005 } } }
I20260812 08:01:50.340655  3598 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:50.340711  3597 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:50.341928  3606 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:50.345084  3606 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:50.350639  3606 catalog_manager.cc:1383] Generated new cluster ID: 349a39d3dadb4cc5861c82d09ced0dc4
I20260812 08:01:50.350715  3606 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:50.390944  3606 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:50.392338  3606 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:50.399151  3606 catalog_manager.cc:6092] T 00000000000000000000000000000000 P f9e205cec89649ddb9ed7d298ffe758b: Generated new TSK 0
I20260812 08:01:50.399783  3606 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:50.408366 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41005
--builtin_ntp_servers=127.29.198.20:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:01:50.520808  3616 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:50.521095  3616 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:50.521160  3616 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:50.521265  3616 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:50.524633  3616 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:50.524732  3616 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:50.524866  3616 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:01:50.528786  3616 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:41005
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:50.529816  3616 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:50.530952  3616 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:50.533818  3616 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:01:50.537948  3626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.537992  3624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.538187  3616 server_base.cc:1061] running on GCE node
W20260812 08:01:50.537971  3623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.538604  3616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:50.539197  3616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:50.540378  3616 hybrid_clock.cc:648] HybridClock initialized: now 1786521710540346 us; error 53 us; skew 500 ppm
I20260812 08:01:50.542249  3616 webserver.cc:533] Webserver started at http://127.29.198.1:39419/ using document root <none> and password file <none>
I20260812 08:01:50.542837  3616 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:50.542922  3616 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:50.543148  3616 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:50.544812  3616 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "03c8f6de87884e67b5a32a73983d6f22"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.545303  3616 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "03c8f6de87884e67b5a32a73983d6f22"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.549008  3616 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:50.551192  3632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.552273  3616 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:50.552400  3616 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "03c8f6de87884e67b5a32a73983d6f22"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.552520  3616 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:50.575395  3616 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:50.576167  3616 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:50.576368  3616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:50.576992  3616 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:50.578017  3616 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:50.578089  3616 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.578183  3616 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:50.578234  3616 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.588195  3616 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:34761
I20260812 08:01:50.588227  3767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:34761 every 8 connection(s)
I20260812 08:01:50.589239  3616 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:50.596390 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 3616
I20260812 08:01:50.596505 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:50.599395 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41005
--builtin_ntp_servers=127.29.198.20:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:01:50.599795  3768 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41005
I20260812 08:01:50.600234  3768 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:50.600769  3768 heartbeater.cc:507] Master 127.29.198.62:41005 requested a full tablet report, sending...
I20260812 08:01:50.602464  3541 ts_manager.cc:194] Registered new tserver with Master: 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761)
I20260812 08:01:50.604183  3541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:39247
W20260812 08:01:50.707525  3772 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:50.707752  3772 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:50.707773  3772 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:50.707819  3772 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:50.711220  3772 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:50.711282  3772 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:50.711352  3772 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:01:50.715179  3772 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:41005
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:50.716321  3772 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:50.717394  3772 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:50.720163  3772 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:01:50.724143  3779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.724150  3781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.724151  3778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.724522  3772 server_base.cc:1061] running on GCE node
I20260812 08:01:50.724920  3772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:50.725476  3772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:50.726665  3772 hybrid_clock.cc:648] HybridClock initialized: now 1786521710726652 us; error 31 us; skew 500 ppm
I20260812 08:01:50.728535  3772 webserver.cc:533] Webserver started at http://127.29.198.2:33097/ using document root <none> and password file <none>
I20260812 08:01:50.729158  3772 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:50.729245  3772 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:50.729470  3772 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:50.731046  3772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "baf26cb428ad4037b6b2e0c8e9aab8db"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.731554  3772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "baf26cb428ad4037b6b2e0c8e9aab8db"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.735368  3772 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:01:50.737982  3788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.739396  3772 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:01:50.739545  3772 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "baf26cb428ad4037b6b2e0c8e9aab8db"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.739665  3772 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:50.763434  3772 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:50.764273  3772 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:50.764504  3772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:50.765229  3772 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:50.766331  3772 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:50.766381  3772 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.766423  3772 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:50.766439  3772 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.775951  3772 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:40347
I20260812 08:01:50.775977  3922 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:40347 every 8 connection(s)
I20260812 08:01:50.776973  3772 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:50.786131  3923 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41005
I20260812 08:01:50.786351  3923 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:50.786733  3923 heartbeater.cc:507] Master 127.29.198.62:41005 requested a full tablet report, sending...
I20260812 08:01:50.787240 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 3772
I20260812 08:01:50.787360 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:50.787745  3541 ts_manager.cc:194] Registered new tserver with Master: baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347)
I20260812 08:01:50.788473  3541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:42749
I20260812 08:01:50.789674 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:41005
--builtin_ntp_servers=127.29.198.20:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:01:50.897298  3926 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:50.897538  3926 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:50.897562  3926 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:50.897607  3926 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:50.901235  3926 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:01:50.901307  3926 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:50.901381  3926 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:01:50.905280  3926 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:41005
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.3926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:50.906410  3926 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:50.907549  3926 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:50.910429  3926 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:01:50.914414  3935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.914414  3939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:50.914429  3937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:50.914775  3926 server_base.cc:1061] running on GCE node
I20260812 08:01:50.915205  3926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:50.915709  3926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:50.916864  3926 hybrid_clock.cc:648] HybridClock initialized: now 1786521710916852 us; error 47 us; skew 500 ppm
I20260812 08:01:50.918656  3926 webserver.cc:533] Webserver started at http://127.29.198.3:39723/ using document root <none> and password file <none>
I20260812 08:01:50.919245  3926 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:50.919302  3926 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:50.919543  3926 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:50.921155  3926 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "0287d88c728846b7936cc91f4bfc4095"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.921645  3926 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "0287d88c728846b7936cc91f4bfc4095"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.925388  3926 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:50.927687  3949 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.928862  3926 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:50.929003  3926 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "0287d88c728846b7936cc91f4bfc4095"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:01:50.929153  3926 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:50.945662  3926 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:50.946339  3926 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:50.946550  3926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:50.947144  3926 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:50.948302  3926 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:50.948371  3926 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.948450  3926 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:50.948493  3926 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:50.958478  3926 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:33113
I20260812 08:01:50.958535  4085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:33113 every 8 connection(s)
I20260812 08:01:50.959486  3926 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:50.966544 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 3926
I20260812 08:01:50.966674 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:50.969614  4086 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41005
I20260812 08:01:50.969861  4086 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:50.970395  4086 heartbeater.cc:507] Master 127.29.198.62:41005 requested a full tablet report, sending...
I20260812 08:01:50.971371  3541 ts_manager.cc:194] Registered new tserver with Master: 0287d88c728846b7936cc91f4bfc4095 (127.29.198.3:33113)
I20260812 08:01:50.971933  3541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:59413
I20260812 08:01:50.981431 30488 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:50.999532  3541 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34998:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:01:51.017251  3688 tablet_service.cc:1511] Processing CreateTablet for tablet c9c359ae11794538aef206c561592eb3 (DEFAULT_TABLE table=test-workload [id=a0dad6bcbcb2447f9c0350089f1dd215]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:51.017321  4007 tablet_service.cc:1511] Processing CreateTablet for tablet c9c359ae11794538aef206c561592eb3 (DEFAULT_TABLE table=test-workload [id=a0dad6bcbcb2447f9c0350089f1dd215]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:51.017551  3845 tablet_service.cc:1511] Processing CreateTablet for tablet c9c359ae11794538aef206c561592eb3 (DEFAULT_TABLE table=test-workload [id=a0dad6bcbcb2447f9c0350089f1dd215]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:51.018230  3688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c359ae11794538aef206c561592eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:51.018258  4007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c359ae11794538aef206c561592eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:51.018281  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9c359ae11794538aef206c561592eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:51.023069  4114 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Bootstrap starting.
I20260812 08:01:51.024345  4115 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: Bootstrap starting.
I20260812 08:01:51.025686  4114 tablet_bootstrap.cc:654] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:51.026073  4115 tablet_bootstrap.cc:654] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:51.026466  4114 log.cc:826] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:51.026784  4115 log.cc:826] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:51.027125  4116 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db: Bootstrap starting.
I20260812 08:01:51.028334  4115 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: No bootstrap required, opened a new log
I20260812 08:01:51.028337  4114 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: No bootstrap required, opened a new log
I20260812 08:01:51.028525  4115 ts_tablet_manager.cc:1403] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: Time spent bootstrapping tablet: real 0.004s	user 0.001s	sys 0.003s
I20260812 08:01:51.028535  4114 ts_tablet_manager.cc:1403] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:51.029232  4116 tablet_bootstrap.cc:654] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:51.030030  4116 log.cc:826] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:51.031323  4115 raft_consensus.cc:359] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.031517  4115 raft_consensus.cc:740] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0287d88c728846b7936cc91f4bfc4095, State: Initialized, Role: FOLLOWER
I20260812 08:01:51.031699  4116 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db: No bootstrap required, opened a new log
I20260812 08:01:51.031718  4114 raft_consensus.cc:359] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.031893  4116 ts_tablet_manager.cc:1403] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:51.031913  4114 raft_consensus.cc:740] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c8f6de87884e67b5a32a73983d6f22, State: Initialized, Role: FOLLOWER
I20260812 08:01:51.031864  4115 consensus_queue.cc:260] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.032228  4114 consensus_queue.cc:260] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.032608  4086 heartbeater.cc:499] Master 127.29.198.62:41005 was elected leader, sending a full tablet report...
I20260812 08:01:51.032778  4115 ts_tablet_manager.cc:1434] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:51.033036  4114 ts_tablet_manager.cc:1434] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:51.033378  3768 heartbeater.cc:499] Master 127.29.198.62:41005 was elected leader, sending a full tablet report...
I20260812 08:01:51.034966  4116 raft_consensus.cc:359] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.035199  4116 raft_consensus.cc:740] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf26cb428ad4037b6b2e0c8e9aab8db, State: Initialized, Role: FOLLOWER
I20260812 08:01:51.035467  4116 consensus_queue.cc:260] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.036109  3923 heartbeater.cc:499] Master 127.29.198.62:41005 was elected leader, sending a full tablet report...
I20260812 08:01:51.036338  4116 ts_tablet_manager.cc:1434] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:51.062485  4031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9c359ae11794538aef206c561592eb3"
dest_uuid: "0287d88c728846b7936cc91f4bfc4095"
 from {username='slave'} at 127.0.0.1:45598
I20260812 08:01:51.062721  4031 raft_consensus.cc:493] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:51.062814  4031 raft_consensus.cc:3060] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:51.063836  4031 raft_consensus.cc:515] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.065079  4031 leader_election.cc:290] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [CANDIDATE]: Term 1 election: Requested vote from peers 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761), baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347)
I20260812 08:01:51.068020 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:01:51.069792  3713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c359ae11794538aef206c561592eb3" candidate_uuid: "0287d88c728846b7936cc91f4bfc4095" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "03c8f6de87884e67b5a32a73983d6f22"
I20260812 08:01:51.069787  3870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9c359ae11794538aef206c561592eb3" candidate_uuid: "0287d88c728846b7936cc91f4bfc4095" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db"
I20260812 08:01:51.070014  3713 raft_consensus.cc:3060] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:51.070014  3870 raft_consensus.cc:3060] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:51.071245  3870 raft_consensus.cc:2468] T c9c359ae11794538aef206c561592eb3 P baf26cb428ad4037b6b2e0c8e9aab8db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0287d88c728846b7936cc91f4bfc4095 in term 1.
I20260812 08:01:51.071245  3713 raft_consensus.cc:2468] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0287d88c728846b7936cc91f4bfc4095 in term 1.
I20260812 08:01:51.071745  3953 leader_election.cc:304] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0287d88c728846b7936cc91f4bfc4095, 03c8f6de87884e67b5a32a73983d6f22, baf26cb428ad4037b6b2e0c8e9aab8db; no voters: 
I20260812 08:01:51.072110  4122 raft_consensus.cc:2804] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:51.072391  4122 raft_consensus.cc:697] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 1 LEADER]: Becoming Leader. State: Replica: 0287d88c728846b7936cc91f4bfc4095, State: Running, Role: LEADER
I20260812 08:01:51.072754  4122 consensus_queue.cc:237] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:01:51.075865  3540 catalog_manager.cc:5719] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0287d88c728846b7936cc91f4bfc4095 (127.29.198.3). New cstate: current_term: 1 leader_uuid: "0287d88c728846b7936cc91f4bfc4095" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } } }
W20260812 08:01:51.090473  3769 tablet.cc:2406] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:51.115955  4122 consensus_queue.cc:1048] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:51.121965  4122 consensus_queue.cc:1048] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:51.172227 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 3616
I20260812 08:01:51.183673 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 3772
W20260812 08:01:51.213158  3953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111)
W20260812 08:01:51.214318  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:51.225265  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:51.468602  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:01:51.475597  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:01:51.723173  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:01:51.726859  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:01:51.962410  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:01:51.973416  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:01:52.176456  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 08:01:52.225430  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 08:01:52.433722  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 08:01:52.468932  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 08:01:52.682062  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 08:01:52.682104  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 08:01:52.903154  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 08:01:52.926446  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 08:01:53.147871  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 08:01:53.162930  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 08:01:53.391498  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 08:01:53.409832  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 08:01:53.635977  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 08:01:53.652328  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 08:01:53.871520  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 08:01:53.894972  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 08:01:54.115535  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 08:01:54.153036  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 08:01:54.387981  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 08:01:54.393682  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 08:01:54.630394  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 08:01:54.639153  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 08:01:54.888701  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 08:01:54.920042  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 08:01:55.137017  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 08:01:55.158262  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 08:01:55.392041  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 08:01:55.407408  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 08:01:55.650274  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 08:01:55.650739  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 08:01:55.899788  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 08:01:55.916260  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 08:01:56.149657  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 08:01:56.183907  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 08:01:56.227893  3953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111) [suppressed 202 similar messages]
W20260812 08:01:56.403815  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 08:01:56.460513  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 08:01:56.726601  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 08:01:56.982514  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 08:01:57.268630  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 08:01:57.511360  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 08:01:57.676625  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 08:01:57.744308  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 08:01:57.929754  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 08:01:58.003382  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 08:01:58.173357  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 08:01:58.277158  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 08:01:58.412735  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 08:01:58.526515  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 08:01:58.673672  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 08:01:58.772152  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 08:01:58.905828  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 08:01:58.995716  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 08:01:59.136427  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 08:01:59.258476  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 08:01:59.401924  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 08:01:59.477888  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 08:01:59.661077  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 08:01:59.747804  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 08:01:59.898809  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 08:02:00.007308  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 08:02:00.120930  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 08:02:00.242158  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 08:02:00.374461  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 08:02:00.488651  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 08:02:00.637919  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 08:02:00.746011  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 08:02:00.885339  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 08:02:00.990355  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 08:02:01.159780  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 08:02:01.230415  3953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111) [suppressed 178 similar messages]
W20260812 08:02:01.231129  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 08:02:01.386943  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 08:02:01.481141  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 08:02:01.629267  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 08:02:01.737527  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 08:02:01.904987  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 08:02:01.972159  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 08:02:02.146703  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 08:02:02.184760  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 08:02:02.355948  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 08:02:02.451577  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 08:02:02.637468  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 08:02:02.686574  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 08:02:02.879254  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 08:02:02.930212  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
W20260812 08:02:03.141171  3951 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761): Couldn't send request to peer 03c8f6de87884e67b5a32a73983d6f22. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34761: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 08:02:03.171742  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 241: this message will repeat every 5th retry.
I20260812 08:02:03.197090 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:34761
--local_ip_for_outbound_sockets=127.29.198.1
--tserver_master_addrs=127.29.198.62:41005
--webserver_port=39419
--webserver_interface=127.29.198.1
--builtin_ntp_servers=127.29.198.20:42215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:02:03.314921  4144 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:03.315239  4144 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:03.315321  4144 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:03.315430  4144 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:03.319741  4144 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:03.319846  4144 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:03.320013  4144 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:02:03.324680  4144 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:34761
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=39419
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:41005
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:03.325899  4144 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:03.327095  4144 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:03.330072  4144 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:03.334070  4150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:03.334116  4151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:03.334203  4153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:03.334570  4144 server_base.cc:1061] running on GCE node
I20260812 08:02:03.334910  4144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:03.335415  4144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:03.336597  4144 hybrid_clock.cc:648] HybridClock initialized: now 1786521723336575 us; error 33 us; skew 500 ppm
I20260812 08:02:03.338649  4144 webserver.cc:533] Webserver started at http://127.29.198.1:39419/ using document root <none> and password file <none>
I20260812 08:02:03.339257  4144 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:03.339365  4144 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:03.342936  4144 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:03.345114  4160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:03.346158  4144 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:03.346282  4144 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "03c8f6de87884e67b5a32a73983d6f22"
format_stamp: "Formatted at 2026-08-12 08:01:50 on dist-test-slave-1zqn"
I20260812 08:02:03.346730  4144 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:03.364512  4144 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:03.365145  4144 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:03.365334  4144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:03.365929  4144 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:03.367130  4172 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:02:03.370499  4144 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:02:03.370585  4144 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:02:03.370684  4144 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:02:03.372210  4144 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:02:03.372277  4144 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:03.372685  4172 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Bootstrap starting.
I20260812 08:02:03.384478  4144 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:34761
I20260812 08:02:03.384521  4292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:34761 every 8 connection(s)
I20260812 08:02:03.385572  4144 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:03.390112  4172 log.cc:826] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:03.392983  4172 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:03.393421  4172 tablet_bootstrap.cc:492] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Bootstrap complete.
I20260812 08:02:03.394704 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 4144
I20260812 08:02:03.395083  4172 ts_tablet_manager.cc:1403] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260812 08:02:03.395756  4293 heartbeater.cc:344] Connected to a master server at 127.29.198.62:41005
I20260812 08:02:03.396095  4293 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:03.396586  4293 heartbeater.cc:507] Master 127.29.198.62:41005 requested a full tablet report, sending...
I20260812 08:02:03.397888  4172 raft_consensus.cc:359] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:02:03.398341  4172 raft_consensus.cc:740] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c8f6de87884e67b5a32a73983d6f22, State: Initialized, Role: FOLLOWER
I20260812 08:02:03.398535  3540 ts_manager.cc:194] Re-registered known tserver with Master: 03c8f6de87884e67b5a32a73983d6f22 (127.29.198.1:34761)
I20260812 08:02:03.398715  4172 consensus_queue.cc:260] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
I20260812 08:02:03.399547  3540 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:50539
I20260812 08:02:03.399593  4172 ts_tablet_manager.cc:1434] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22: Time spent starting tablet: real 0.004s	user 0.007s	sys 0.000s
I20260812 08:02:03.402108  4293 heartbeater.cc:499] Master 127.29.198.62:41005 was elected leader, sending a full tablet report...
I20260812 08:02:03.408881  4301 raft_consensus.cc:1012] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095: Attempting to remove follower baf26cb428ad4037b6b2e0c8e9aab8db from the Raft config. Reason: Leader has been unable to successfully communicate with peer baf26cb428ad4037b6b2e0c8e9aab8db for more than 3 seconds (12.249s)
I20260812 08:02:03.409687  4301 consensus_queue.cc:237] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } }
I20260812 08:02:03.410974  4242 raft_consensus.cc:1275] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 1 FOLLOWER]: Refusing update from remote peer 0287d88c728846b7936cc91f4bfc4095: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:03.411451  4141 consensus_queue.cc:1048] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:03.414044  4301 raft_consensus.cc:2955] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } }
I20260812 08:02:03.414636  4242 raft_consensus.cc:2955] T c9c359ae11794538aef206c561592eb3 P 03c8f6de87884e67b5a32a73983d6f22 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } }
I20260812 08:02:03.416646  3540 catalog_manager.cc:5719] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 reported cstate change: config changed from index -1 to 2, VOTER baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2) evicted. New cstate: current_term: 1 leader_uuid: "0287d88c728846b7936cc91f4bfc4095" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } }
I20260812 08:02:03.417141 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 4144
W20260812 08:02:03.424337  3526 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111)
I20260812 08:02:03.424511  4031 consensus_queue.cc:237] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0287d88c728846b7936cc91f4bfc4095" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33113 } } peers { permanent_uuid: "03c8f6de87884e67b5a32a73983d6f22" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 34761 } } peers { permanent_uuid: "baf26cb428ad4037b6b2e0c8e9aab8db" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 40347 } }
W20260812 08:02:03.426149  3526 catalog_manager.cc:4777] TS baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c9c359ae11794538aef206c561592eb3: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111)
W20260812 08:02:03.427237  3953 consensus_peers.cc:597] T c9c359ae11794538aef206c561592eb3 P 0287d88c728846b7936cc91f4bfc4095 -> Peer baf26cb428ad4037b6b2e0c8e9aab8db (127.29.198.2:40347): Couldn't send request to peer baf26cb428ad4037b6b2e0c8e9aab8db. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:40347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:03.434173  3951 connection.cc:573] client connection to 127.29.198.1:34761 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:03.434552 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 3926
I20260812 08:02:03.445434 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 3504
2026-08-12T08:02:03Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/0 (13324 ms)
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/1
2026-08-12T08:02:03Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:03Z Disabled control of system clock
I20260812 08:02:03.480556 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:32919
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:32919
--raft_prepare_replacement_before_eviction=true
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:03.587641  4315 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:03.587870  4315 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:03.587913  4315 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:03.591168  4315 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:03.591239  4315 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:03.591264  4315 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:03.591284  4315 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:03.595079  4315 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:32919
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:32919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.4315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:03.596195  4315 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:03.597294  4315 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:03.603163  4321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:03.603168  4325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:03.603560  4315 server_base.cc:1061] running on GCE node
W20260812 08:02:03.603168  4320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:03.604358  4315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:03.605401  4315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:03.606614  4315 hybrid_clock.cc:648] HybridClock initialized: now 1786521723606603 us; error 39 us; skew 500 ppm
I20260812 08:02:03.608560  4315 webserver.cc:533] Webserver started at http://127.29.198.62:41561/ using document root <none> and password file <none>
I20260812 08:02:03.609162  4315 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:03.609247  4315 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:03.609476  4315 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:03.611094  4315 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "70689ab114794cc5b7c25f7a80d63c72"
format_stamp: "Formatted at 2026-08-12 08:02:03 on dist-test-slave-1zqn"
I20260812 08:02:03.611603  4315 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "70689ab114794cc5b7c25f7a80d63c72"
format_stamp: "Formatted at 2026-08-12 08:02:03 on dist-test-slave-1zqn"
I20260812 08:02:03.615073  4315 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:03.617529  4332 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:03.618598  4315 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:03.618726  4315 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "70689ab114794cc5b7c25f7a80d63c72"
format_stamp: "Formatted at 2026-08-12 08:02:03 on dist-test-slave-1zqn"
I20260812 08:02:03.618806  4315 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:03.646854  4315 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:03.647631  4315 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:03.647789  4315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:03.655395  4392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:32919 every 8 connection(s)
I20260812 08:02:03.655405  4315 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:32919
I20260812 08:02:03.656654  4315 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:03.659512  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:03.664516  4393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72: Bootstrap starting.
I20260812 08:02:03.666258 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 4315
I20260812 08:02:03.666388 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:02:03.667079  4393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:03.667975  4393 log.cc:826] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:03.669792  4393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72: No bootstrap required, opened a new log
I20260812 08:02:03.672430  4393 raft_consensus.cc:359] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70689ab114794cc5b7c25f7a80d63c72" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32919 } }
I20260812 08:02:03.672639  4393 raft_consensus.cc:385] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:03.672727  4393 raft_consensus.cc:740] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70689ab114794cc5b7c25f7a80d63c72, State: Initialized, Role: FOLLOWER
I20260812 08:02:03.673195  4393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70689ab114794cc5b7c25f7a80d63c72" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32919 } }
I20260812 08:02:03.673347  4393 raft_consensus.cc:399] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:03.673418  4393 raft_consensus.cc:493] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:03.673571  4393 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:03.674434  4393 raft_consensus.cc:515] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70689ab114794cc5b7c25f7a80d63c72" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32919 } }
I20260812 08:02:03.674803  4393 leader_election.cc:304] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70689ab114794cc5b7c25f7a80d63c72; no voters: 
I20260812 08:02:03.675135  4393 leader_election.cc:290] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:03.675210  4399 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:03.675460  4399 raft_consensus.cc:697] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [term 1 LEADER]: Becoming Leader. State: Replica: 70689ab114794cc5b7c25f7a80d63c72, State: Running, Role: LEADER
I20260812 08:02:03.675792  4399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70689ab114794cc5b7c25f7a80d63c72" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32919 } }
I20260812 08:02:03.676331  4393 sys_catalog.cc:565] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:03.677870  4400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70689ab114794cc5b7c25f7a80d63c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70689ab114794cc5b7c25f7a80d63c72" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32919 } } }
I20260812 08:02:03.678045  4400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:03.678025  4402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70689ab114794cc5b7c25f7a80d63c72. Latest consensus state: current_term: 1 leader_uuid: "70689ab114794cc5b7c25f7a80d63c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70689ab114794cc5b7c25f7a80d63c72" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 32919 } } }
I20260812 08:02:03.678224  4402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:03.679066  4412 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:03.681948  4412 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:03.687117  4412 catalog_manager.cc:1383] Generated new cluster ID: 8fe737f814ac4307ab1a0b6bfcf4e9ff
I20260812 08:02:03.687199  4412 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:03.720239  4412 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:03.721397  4412 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:03.732949  4412 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 70689ab114794cc5b7c25f7a80d63c72: Generated new TSK 0
I20260812 08:02:03.733598  4412 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:03.745527 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32919
--builtin_ntp_servers=127.29.198.20:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:02:03.861392  4423 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:03.861631  4423 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:03.861654  4423 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:03.861769  4423 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:03.865695  4423 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:03.865875  4423 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:02:03.870186  4423 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:32919
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:03.871450  4423 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:03.872709  4423 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:03.875648  4423 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:03.879976  4429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:03.879979  4428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:03.879976  4431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:03.880579  4423 server_base.cc:1061] running on GCE node
I20260812 08:02:03.880972  4423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:03.881606  4423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:03.882781  4423 hybrid_clock.cc:648] HybridClock initialized: now 1786521723882765 us; error 34 us; skew 500 ppm
I20260812 08:02:03.884913  4423 webserver.cc:533] Webserver started at http://127.29.198.1:40667/ using document root <none> and password file <none>
I20260812 08:02:03.885519  4423 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:03.885579  4423 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:03.885790  4423 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:03.887377  4423 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "6dd2cb9fdbee45c7adb96e2727a43b46"
format_stamp: "Formatted at 2026-08-12 08:02:03 on dist-test-slave-1zqn"
I20260812 08:02:03.887904  4423 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "6dd2cb9fdbee45c7adb96e2727a43b46"
format_stamp: "Formatted at 2026-08-12 08:02:03 on dist-test-slave-1zqn"
I20260812 08:02:03.891382  4423 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:03.893731  4437 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:03.894801  4423 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:03.894899  4423 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "6dd2cb9fdbee45c7adb96e2727a43b46"
format_stamp: "Formatted at 2026-08-12 08:02:03 on dist-test-slave-1zqn"
I20260812 08:02:03.895025  4423 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:03.916299  4423 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:03.917151  4423 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:03.917382  4423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:03.918040  4423 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:03.919166  4423 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:03.919219  4423 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:03.919262  4423 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:03.919330  4423 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:03.930343  4423 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:34115
I20260812 08:02:03.930367  4579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:34115 every 8 connection(s)
I20260812 08:02:03.931384  4423 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:03.933256 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 4423
I20260812 08:02:03.933396 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:03.936017 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32919
--builtin_ntp_servers=127.29.198.20:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:03.941720  4580 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32919
I20260812 08:02:03.942010  4580 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:03.942565  4580 heartbeater.cc:507] Master 127.29.198.62:32919 requested a full tablet report, sending...
I20260812 08:02:03.944082  4349 ts_manager.cc:194] Registered new tserver with Master: 6dd2cb9fdbee45c7adb96e2727a43b46 (127.29.198.1:34115)
I20260812 08:02:03.945282  4349 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:46777
W20260812 08:02:04.048650  4586 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:04.048938  4586 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:04.049111  4586 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:04.049206  4586 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:04.052620  4586 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:04.052791  4586 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:02:04.056582  4586 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:32919
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:04.057709  4586 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:04.058857  4586 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:04.061602  4586 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:04.065465  4594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:04.065477  4593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:04.065464  4596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:04.065801  4586 server_base.cc:1061] running on GCE node
I20260812 08:02:04.066228  4586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:04.066766  4586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:04.067976  4586 hybrid_clock.cc:648] HybridClock initialized: now 1786521724067929 us; error 61 us; skew 500 ppm
I20260812 08:02:04.070328  4586 webserver.cc:533] Webserver started at http://127.29.198.2:40179/ using document root <none> and password file <none>
I20260812 08:02:04.070952  4586 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:04.071017  4586 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:04.071255  4586 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:04.072938  4586 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "d90734945e2d4a778b54474ac953bee3"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.073483  4586 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "d90734945e2d4a778b54474ac953bee3"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.077128  4586 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:04.079569  4603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.080699  4586 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:04.080837  4586 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "d90734945e2d4a778b54474ac953bee3"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.080941  4586 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:04.097594  4586 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:04.098320  4586 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:04.098526  4586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:04.099167  4586 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:04.100348  4586 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:04.100419  4586 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.100488  4586 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:04.100543  4586 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.110782  4586 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:36519
I20260812 08:02:04.110846  4739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:36519 every 8 connection(s)
I20260812 08:02:04.111783  4586 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:04.114241 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 4586
I20260812 08:02:04.114373 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:04.116938 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32919
--builtin_ntp_servers=127.29.198.20:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:04.121371  4740 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32919
I20260812 08:02:04.121659  4740 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:04.122426  4740 heartbeater.cc:507] Master 127.29.198.62:32919 requested a full tablet report, sending...
I20260812 08:02:04.123716  4349 ts_manager.cc:194] Registered new tserver with Master: d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519)
I20260812 08:02:04.124387  4349 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:52339
W20260812 08:02:04.227334  4743 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:04.227630  4743 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:04.227722  4743 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:04.227835  4743 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:04.231254  4743 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:04.231423  4743 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:02:04.235657  4743 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:32919
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:04.236886  4743 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:04.238081  4743 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:04.240999  4743 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:04.246256  4750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:04.246409  4749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:04.246443  4754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:04.247144  4743 server_base.cc:1061] running on GCE node
I20260812 08:02:04.247617  4743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:04.248368  4743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:04.249567  4743 hybrid_clock.cc:648] HybridClock initialized: now 1786521724249541 us; error 43 us; skew 500 ppm
I20260812 08:02:04.251924  4743 webserver.cc:533] Webserver started at http://127.29.198.3:41203/ using document root <none> and password file <none>
I20260812 08:02:04.252672  4743 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:04.252759  4743 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:04.252976  4743 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:04.254597  4743 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "847a493510284e4eaaec08d25eec6663"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.255119  4743 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "847a493510284e4eaaec08d25eec6663"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.258720  4743 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.003s
I20260812 08:02:04.261099  4761 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.262251  4743 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:04.262401  4743 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "847a493510284e4eaaec08d25eec6663"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.262526  4743 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:04.296085  4743 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:04.296960  4743 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:04.297152  4743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:04.297816  4743 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:04.299041  4743 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:04.299090  4743 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.299139  4743 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:04.299160  4743 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.309785  4743 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:42447
I20260812 08:02:04.309814  4897 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:42447 every 8 connection(s)
I20260812 08:02:04.310789  4743 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:04.314873 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 4743
I20260812 08:02:04.314998 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:04.317483 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.4:0
--local_ip_for_outbound_sockets=127.29.198.4
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:32919
--builtin_ntp_servers=127.29.198.20:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:04.320510  4898 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32919
I20260812 08:02:04.320778  4898 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:04.321408  4898 heartbeater.cc:507] Master 127.29.198.62:32919 requested a full tablet report, sending...
I20260812 08:02:04.322654  4349 ts_manager.cc:194] Registered new tserver with Master: 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447)
I20260812 08:02:04.323494  4349 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:48653
W20260812 08:02:04.427518  4902 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:04.427757  4902 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:04.427779  4902 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:04.427826  4902 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:04.431200  4902 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:04.431322  4902 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.4
I20260812 08:02:04.435145  4902 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.29.198.4
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:32919
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.4902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:04.436236  4902 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:04.437321  4902 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:04.440155  4902 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:04.444209  4907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:04.444222  4911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:04.444227  4909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:04.444649  4902 server_base.cc:1061] running on GCE node
I20260812 08:02:04.445036  4902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:04.445603  4902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:04.446784  4902 hybrid_clock.cc:648] HybridClock initialized: now 1786521724446733 us; error 63 us; skew 500 ppm
I20260812 08:02:04.448647  4902 webserver.cc:533] Webserver started at http://127.29.198.4:40595/ using document root <none> and password file <none>
I20260812 08:02:04.449222  4902 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:04.449307  4902 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:04.449532  4902 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:04.451056  4902 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data/instance:
uuid: "22509dbe1455482ebf17f513468e6dcf"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.451555  4902 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance:
uuid: "22509dbe1455482ebf17f513468e6dcf"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.454857  4902 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:04.457159  4918 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.458196  4902 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:04.458330  4902 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
uuid: "22509dbe1455482ebf17f513468e6dcf"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:04.458434  4902 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:04.473718  4902 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:04.474371  4902 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:04.474581  4902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:04.475173  4902 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:04.476265  4902 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:04.476336  4902 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.476409  4902 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:04.476460  4902 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:04.487340  4902 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.4:38299
I20260812 08:02:04.487365  5054 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.4:38299 every 8 connection(s)
I20260812 08:02:04.488462  4902 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
I20260812 08:02:04.495277 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 4902
I20260812 08:02:04.495407 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance
I20260812 08:02:04.497416  5056 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32919
I20260812 08:02:04.497680  5056 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:04.498167  5056 heartbeater.cc:507] Master 127.29.198.62:32919 requested a full tablet report, sending...
I20260812 08:02:04.499199  4348 ts_manager.cc:194] Registered new tserver with Master: 22509dbe1455482ebf17f513468e6dcf (127.29.198.4:38299)
I20260812 08:02:04.499765  4348 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.4:53073
I20260812 08:02:04.509909 30488 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 08:02:04.527354  4348 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50764:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:02:04.545662  4818 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4 (DEFAULT_TABLE table=test-workload [id=6da86f2933ac4811a3af13566ef433be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:04.545668  4975 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4 (DEFAULT_TABLE table=test-workload [id=6da86f2933ac4811a3af13566ef433be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:04.545671  4662 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4 (DEFAULT_TABLE table=test-workload [id=6da86f2933ac4811a3af13566ef433be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:04.546674  4818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:04.546679  4975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:04.546679  4662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:04.551834  5081 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Bootstrap starting.
I20260812 08:02:04.553031  5084 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: Bootstrap starting.
I20260812 08:02:04.554706  5081 tablet_bootstrap.cc:654] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:04.554879  5084 tablet_bootstrap.cc:654] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:04.555540  5081 log.cc:826] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:04.555554  5084 log.cc:826] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:04.556262  5082 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf: Bootstrap starting.
I20260812 08:02:04.557221  5081 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: No bootstrap required, opened a new log
I20260812 08:02:04.557423  5081 ts_tablet_manager.cc:1403] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:04.558100  5082 tablet_bootstrap.cc:654] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:04.558912  5082 log.cc:826] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:04.560375  5081 raft_consensus.cc:359] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.560491  5084 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: No bootstrap required, opened a new log
I20260812 08:02:04.560587  5081 raft_consensus.cc:740] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a493510284e4eaaec08d25eec6663, State: Initialized, Role: FOLLOWER
I20260812 08:02:04.560681  5082 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf: No bootstrap required, opened a new log
I20260812 08:02:04.560703  5084 ts_tablet_manager.cc:1403] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.000s
I20260812 08:02:04.560856  5082 ts_tablet_manager.cc:1403] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:04.560941  5081 consensus_queue.cc:260] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.561640  4898 heartbeater.cc:499] Master 127.29.198.62:32919 was elected leader, sending a full tablet report...
I20260812 08:02:04.563484  5081 ts_tablet_manager.cc:1434] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:04.563800  5084 raft_consensus.cc:359] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.563798  5082 raft_consensus.cc:359] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.564005  5084 raft_consensus.cc:740] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d90734945e2d4a778b54474ac953bee3, State: Initialized, Role: FOLLOWER
I20260812 08:02:04.564005  5082 raft_consensus.cc:740] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22509dbe1455482ebf17f513468e6dcf, State: Initialized, Role: FOLLOWER
I20260812 08:02:04.564364  5082 consensus_queue.cc:260] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.564364  5084 consensus_queue.cc:260] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.565217  5084 ts_tablet_manager.cc:1434] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260812 08:02:04.565300  4740 heartbeater.cc:499] Master 127.29.198.62:32919 was elected leader, sending a full tablet report...
I20260812 08:02:04.565462  5082 ts_tablet_manager.cc:1434] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:04.565600  5056 heartbeater.cc:499] Master 127.29.198.62:32919 was elected leader, sending a full tablet report...
I20260812 08:02:04.602496  4999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b7b9454a6e54692bb05b36d6b0b8fb4"
dest_uuid: "22509dbe1455482ebf17f513468e6dcf"
 from {username='slave'} at 127.0.0.1:57102
I20260812 08:02:04.602784  4999 raft_consensus.cc:493] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:04.602927  4999 raft_consensus.cc:3060] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:04.603937  4999 raft_consensus.cc:515] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:04.605051  4999 leader_election.cc:290] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [CANDIDATE]: Term 1 election: Requested vote from peers d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519), 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447)
I20260812 08:02:04.609099 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:02:04.609375  4840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7b9454a6e54692bb05b36d6b0b8fb4" candidate_uuid: "22509dbe1455482ebf17f513468e6dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "847a493510284e4eaaec08d25eec6663"
I20260812 08:02:04.609604  4840 raft_consensus.cc:3060] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:04.610355  4688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b7b9454a6e54692bb05b36d6b0b8fb4" candidate_uuid: "22509dbe1455482ebf17f513468e6dcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d90734945e2d4a778b54474ac953bee3"
I20260812 08:02:04.610574  4688 raft_consensus.cc:3060] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:04.610853  4840 raft_consensus.cc:2468] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22509dbe1455482ebf17f513468e6dcf in term 1.
I20260812 08:02:04.611325  4920 leader_election.cc:304] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22509dbe1455482ebf17f513468e6dcf, 847a493510284e4eaaec08d25eec6663; no voters: 
I20260812 08:02:04.611629  5090 raft_consensus.cc:2804] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:04.611675  4688 raft_consensus.cc:2468] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22509dbe1455482ebf17f513468e6dcf in term 1.
I20260812 08:02:04.612046  5090 raft_consensus.cc:697] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 1 LEADER]: Becoming Leader. State: Replica: 22509dbe1455482ebf17f513468e6dcf, State: Running, Role: LEADER
I20260812 08:02:04.612427  5090 consensus_queue.cc:237] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
W20260812 08:02:04.612944  4741 tablet.cc:2406] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P d90734945e2d4a778b54474ac953bee3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:04.615877  4348 catalog_manager.cc:5719] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 22509dbe1455482ebf17f513468e6dcf (127.29.198.4). New cstate: current_term: 1 leader_uuid: "22509dbe1455482ebf17f513468e6dcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:04.659972  5090 consensus_queue.cc:1048] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:04.666416  5105 consensus_queue.cc:1048] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:04.712968 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 4743
W20260812 08:02:04.727232  4920 connection.cc:573] client connection to 127.29.198.3:42447 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:04.727406  4920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:04.727639 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 4586
W20260812 08:02:04.729488  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:04.760627  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:04.998036  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:02:05.007251  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:02:05.269496  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:02:05.272411  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:02:05.524684  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:02:05.531489  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:02:05.768824  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 08:02:05.770480  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 08:02:05.983161  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 08:02:06.023655  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 08:02:06.201594  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 08:02:06.262089  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 08:02:06.431654  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 08:02:06.535050  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 08:02:06.666887  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 08:02:06.801932  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 08:02:06.903002  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 08:02:07.035620  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 08:02:07.136622  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 08:02:07.273823  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 08:02:07.394300  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 08:02:07.542572  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 08:02:07.659298  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260812 08:02:07.672441  5105 consensus_queue.cc:579] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Leader has been unable to successfully communicate with peer 847a493510284e4eaaec08d25eec6663 for more than 3 seconds (3.003s)
I20260812 08:02:07.751124  5117 consensus_queue.cc:579] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Leader has been unable to successfully communicate with peer d90734945e2d4a778b54474ac953bee3 for more than 3 seconds (3.041s)
W20260812 08:02:07.781579  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260812 08:02:07.909339  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 08:02:08.031309  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260812 08:02:08.150615  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 08:02:08.282729  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260812 08:02:08.388875  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 08:02:08.528556  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260812 08:02:08.637763  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 08:02:08.773890  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260812 08:02:08.910851  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 08:02:09.027745  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260812 08:02:09.157647  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 08:02:09.261448  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260812 08:02:09.413987  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 08:02:09.537250  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20260812 08:02:09.684244  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 08:02:09.727523  4920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111) [suppressed 199 similar messages]
W20260812 08:02:09.769860  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20260812 08:02:09.945868  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
I20260812 08:02:09.947615  4580 heartbeater.cc:499] Master 127.29.198.62:32919 was elected leader, sending a full tablet report...
W20260812 08:02:10.041049  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20260812 08:02:10.181708  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 08:02:10.305846  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20260812 08:02:10.422577  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 08:02:10.562448  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20260812 08:02:10.659000  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 08:02:10.804313  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20260812 08:02:10.920603  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 08:02:11.064092  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20260812 08:02:11.154031  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 08:02:11.332145  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20260812 08:02:11.355837  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 08:02:11.560542  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20260812 08:02:11.648342  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 08:02:11.796716  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20260812 08:02:11.903200  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 08:02:12.047592  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20260812 08:02:12.119652  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 08:02:12.331638  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20260812 08:02:12.372090  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 08:02:12.591039  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20260812 08:02:12.615805  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 08:02:12.835917  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 08:02:12.840607  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20260812 08:02:13.078989  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 08:02:13.102187  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20260812 08:02:13.305989  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 08:02:13.375685  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20260812 08:02:13.559933  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 08:02:13.656002  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20260812 08:02:13.817404  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 08:02:13.897591  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20260812 08:02:14.073419  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 08:02:14.142477  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20260812 08:02:14.327448  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 08:02:14.409299  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20260812 08:02:14.612152  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 08:02:14.656287  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20260812 08:02:14.762277  4920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111) [suppressed 199 similar messages]
W20260812 08:02:14.879216  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 08:02:14.920982  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20260812 08:02:15.126626  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 08:02:15.164000  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20260812 08:02:15.379514  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 08:02:15.434130  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20260812 08:02:15.625095  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 08:02:15.704880  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 216: this message will repeat every 5th retry.
W20260812 08:02:15.861244  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 08:02:15.925644  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 221: this message will repeat every 5th retry.
W20260812 08:02:16.095920  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 08:02:16.192373  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 226: this message will repeat every 5th retry.
W20260812 08:02:16.350136  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
W20260812 08:02:16.426796  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 231: this message will repeat every 5th retry.
W20260812 08:02:16.610991  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 241: this message will repeat every 5th retry.
W20260812 08:02:16.676261  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447): Couldn't send request to peer 847a493510284e4eaaec08d25eec6663. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.3:42447: connect: Connection refused (error 111). This is attempt 236: this message will repeat every 5th retry.
I20260812 08:02:16.738873 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:42447
--local_ip_for_outbound_sockets=127.29.198.3
--tserver_master_addrs=127.29.198.62:32919
--webserver_port=41203
--webserver_interface=127.29.198.3
--builtin_ntp_servers=127.29.198.20:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:02:16.856566  5128 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:16.856848  5128 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:16.856920  5128 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:16.857017  5128 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:16.860483  5128 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:16.860657  5128 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:02:16.864858  5128 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:42447
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=41203
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:32919
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.5128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:16.866036  5128 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:16.867396  5128 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:16.868033  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 246: this message will repeat every 5th retry.
E20260812 08:02:16.870266  5128 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
I20260812 08:02:16.874858  5128 server_base.cc:1061] running on GCE node
W20260812 08:02:16.874809  5134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:16.874826  5135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:16.874794  5138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:16.875538  5128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:16.876204  5128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:16.877380  5128 hybrid_clock.cc:648] HybridClock initialized: now 1786521736877354 us; error 58 us; skew 500 ppm
I20260812 08:02:16.879330  5128 webserver.cc:533] Webserver started at http://127.29.198.3:41203/ using document root <none> and password file <none>
I20260812 08:02:16.879963  5128 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:16.880124  5128 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:16.883888  5128 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.002s
I20260812 08:02:16.886154  5144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:16.887293  5128 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:16.887466  5128 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "847a493510284e4eaaec08d25eec6663"
format_stamp: "Formatted at 2026-08-12 08:02:04 on dist-test-slave-1zqn"
I20260812 08:02:16.887924  5128 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:16.907933  5128 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:16.908860  5128 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:16.909122  5128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:16.909863  5128 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:16.911324  5152 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:02:16.915014  5128 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:02:16.915092  5128 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:02:16.915189  5128 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:02:16.916971  5128 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:02:16.917042  5128 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:16.917420  5152 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Bootstrap starting.
I20260812 08:02:16.931195  5128 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:42447
I20260812 08:02:16.931221  5282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:42447 every 8 connection(s)
I20260812 08:02:16.932554  5128 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesDown_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:16.936254  5152 log.cc:826] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:16.937557 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 5128
I20260812 08:02:16.939292  5152 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:16.939666  5152 tablet_bootstrap.cc:492] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Bootstrap complete.
I20260812 08:02:16.941248  5152 ts_tablet_manager.cc:1403] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260812 08:02:16.943720  5152 raft_consensus.cc:359] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:16.944191  5152 raft_consensus.cc:740] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a493510284e4eaaec08d25eec6663, State: Initialized, Role: FOLLOWER
I20260812 08:02:16.944568  5152 consensus_queue.cc:260] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } }
I20260812 08:02:16.945356  5152 ts_tablet_manager.cc:1434] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.001s
I20260812 08:02:16.947671  5283 heartbeater.cc:344] Connected to a master server at 127.29.198.62:32919
I20260812 08:02:16.947923  5283 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:16.948504  5283 heartbeater.cc:507] Master 127.29.198.62:32919 requested a full tablet report, sending...
I20260812 08:02:16.950685  4348 ts_manager.cc:194] Re-registered known tserver with Master: 847a493510284e4eaaec08d25eec6663 (127.29.198.3:42447)
I20260812 08:02:16.951722  4348 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:39901
I20260812 08:02:16.954257  5283 heartbeater.cc:499] Master 127.29.198.62:32919 was elected leader, sending a full tablet report...
I20260812 08:02:16.994243  4999 consensus_queue.cc:237] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } } peers { permanent_uuid: "6dd2cb9fdbee45c7adb96e2727a43b46" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 34115 } attrs { promote: true } }
W20260812 08:02:16.996668  4922 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer d90734945e2d4a778b54474ac953bee3 (127.29.198.2:36519): Couldn't send request to peer d90734945e2d4a778b54474ac953bee3. Status: Network error: Client connection negotiation failed: client connection to 127.29.198.2:36519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:16.996701  5224 raft_consensus.cc:1275] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 1 FOLLOWER]: Refusing update from remote peer 22509dbe1455482ebf17f513468e6dcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:16.997243  5291 consensus_queue.cc:1048] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 08:02:17.001158  4920 consensus_peers.cc:597] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 6dd2cb9fdbee45c7adb96e2727a43b46 (127.29.198.1:34115): Couldn't send request to peer 6dd2cb9fdbee45c7adb96e2727a43b46. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b7b9454a6e54692bb05b36d6b0b8fb4. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:17.001701  5123 raft_consensus.cc:2955] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dd2cb9fdbee45c7adb96e2727a43b46 (127.29.198.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } } peers { permanent_uuid: "6dd2cb9fdbee45c7adb96e2727a43b46" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 34115 } attrs { promote: true } } }
I20260812 08:02:17.002391  5224 raft_consensus.cc:2955] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 847a493510284e4eaaec08d25eec6663 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6dd2cb9fdbee45c7adb96e2727a43b46 (127.29.198.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } } peers { permanent_uuid: "6dd2cb9fdbee45c7adb96e2727a43b46" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 34115 } attrs { promote: true } } }
I20260812 08:02:17.004093  4333 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 5b7b9454a6e54692bb05b36d6b0b8fb4 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 08:02:17.005307  4348 catalog_manager.cc:5719] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf reported cstate change: config changed from index -1 to 2, NON_VOTER 6dd2cb9fdbee45c7adb96e2727a43b46 (127.29.198.1) added. New cstate: current_term: 1 leader_uuid: "22509dbe1455482ebf17f513468e6dcf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d90734945e2d4a778b54474ac953bee3" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 36519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847a493510284e4eaaec08d25eec6663" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 42447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22509dbe1455482ebf17f513468e6dcf" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 38299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dd2cb9fdbee45c7adb96e2727a43b46" member_type: NON_VOTER last_known_addr { host: "127.29.198.1" port: 34115 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:17.010532 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 4423
I20260812 08:02:17.024995 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 5128
W20260812 08:02:17.035900  4920 consensus_peers.cc:576] T 5b7b9454a6e54692bb05b36d6b0b8fb4 P 22509dbe1455482ebf17f513468e6dcf -> Peer 6dd2cb9fdbee45c7adb96e2727a43b46 (127.29.198.1:34115): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.29.198.1:34115: connect: Connection refused (error 111)
I20260812 08:02:17.037563 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 4902
I20260812 08:02:17.049208 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 4315
2026-08-12T08:02:17Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesDown/1 (13604 ms)
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/0
2026-08-12T08:02:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:17Z Disabled control of system clock
I20260812 08:02:17.085410 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:37705
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:41285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:37705
--raft_prepare_replacement_before_eviction=false
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:17.192483  5308 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:17.192734  5308 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:17.192775  5308 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:17.196039  5308 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:17.196131  5308 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:17.196151  5308 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:17.196171  5308 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:17.196189  5308 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:17.200178  5308 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:41285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:37705
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:37705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.5308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:17.201294  5308 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:17.202423  5308 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:17.208298  5314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.208331  5316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.208299  5313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:17.208668  5308 server_base.cc:1061] running on GCE node
I20260812 08:02:17.209335  5308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:17.210307  5308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:17.211517  5308 hybrid_clock.cc:648] HybridClock initialized: now 1786521737211515 us; error 47 us; skew 500 ppm
I20260812 08:02:17.213552  5308 webserver.cc:533] Webserver started at http://127.29.198.62:39497/ using document root <none> and password file <none>
I20260812 08:02:17.214185  5308 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:17.214277  5308 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:17.214530  5308 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:17.216297  5308 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "96aaf826e01c4bebb153e4fc4c902b77"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.216814  5308 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "96aaf826e01c4bebb153e4fc4c902b77"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.220400  5308 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:17.222797  5323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.224328  5308 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:17.224478  5308 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "96aaf826e01c4bebb153e4fc4c902b77"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.224596  5308 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:17.240479  5308 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:17.241331  5308 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:17.241561  5308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:17.250168  5308 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:37705
I20260812 08:02:17.250195  5386 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:37705 every 8 connection(s)
I20260812 08:02:17.251302  5308 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:17.254647  5387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:17.260417  5387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77: Bootstrap starting.
I20260812 08:02:17.261245 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 5308
I20260812 08:02:17.261399 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:02:17.263615  5387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:17.264559  5387 log.cc:826] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:17.266373  5387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77: No bootstrap required, opened a new log
I20260812 08:02:17.269562  5387 raft_consensus.cc:359] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96aaf826e01c4bebb153e4fc4c902b77" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37705 } }
I20260812 08:02:17.269805  5387 raft_consensus.cc:385] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:17.269902  5387 raft_consensus.cc:740] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96aaf826e01c4bebb153e4fc4c902b77, State: Initialized, Role: FOLLOWER
I20260812 08:02:17.270462  5387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96aaf826e01c4bebb153e4fc4c902b77" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37705 } }
I20260812 08:02:17.270642  5387 raft_consensus.cc:399] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:17.270720  5387 raft_consensus.cc:493] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:17.270874  5387 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:17.272128  5387 raft_consensus.cc:515] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96aaf826e01c4bebb153e4fc4c902b77" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37705 } }
I20260812 08:02:17.272468  5387 leader_election.cc:304] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96aaf826e01c4bebb153e4fc4c902b77; no voters: 
I20260812 08:02:17.272770  5387 leader_election.cc:290] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:17.272921  5393 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:17.273169  5393 raft_consensus.cc:697] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [term 1 LEADER]: Becoming Leader. State: Replica: 96aaf826e01c4bebb153e4fc4c902b77, State: Running, Role: LEADER
I20260812 08:02:17.273522  5393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96aaf826e01c4bebb153e4fc4c902b77" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37705 } }
I20260812 08:02:17.273991  5387 sys_catalog.cc:565] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:17.275190  5394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96aaf826e01c4bebb153e4fc4c902b77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96aaf826e01c4bebb153e4fc4c902b77" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37705 } } }
I20260812 08:02:17.275343  5394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:17.275772  5404 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:17.275823  5395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96aaf826e01c4bebb153e4fc4c902b77. Latest consensus state: current_term: 1 leader_uuid: "96aaf826e01c4bebb153e4fc4c902b77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96aaf826e01c4bebb153e4fc4c902b77" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 37705 } } }
I20260812 08:02:17.275976  5395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:17.279141  5404 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:17.285310  5404 catalog_manager.cc:1383] Generated new cluster ID: cfdede5decc745b48841376abb29552e
I20260812 08:02:17.285413  5404 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:17.295454  5404 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:17.296761  5404 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:17.313884  5404 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 96aaf826e01c4bebb153e4fc4c902b77: Generated new TSK 0
I20260812 08:02:17.314617  5404 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:17.318159 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37705
--builtin_ntp_servers=127.29.198.20:41285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:02:17.427909  5417 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:17.428232  5417 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:17.428293  5417 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:17.428402  5417 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:17.432008  5417 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:17.432142  5417 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:17.432286  5417 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:02:17.436481  5417 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:41285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:37705
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.5417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:17.437637  5417 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:17.438922  5417 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:17.441859  5417 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:17.446014  5424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.446022  5423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.446105  5426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:17.446275  5417 server_base.cc:1061] running on GCE node
I20260812 08:02:17.446870  5417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:17.447678  5417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:17.448884  5417 hybrid_clock.cc:648] HybridClock initialized: now 1786521737448857 us; error 55 us; skew 500 ppm
I20260812 08:02:17.451040  5417 webserver.cc:533] Webserver started at http://127.29.198.1:33161/ using document root <none> and password file <none>
I20260812 08:02:17.451721  5417 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:17.451786  5417 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:17.451990  5417 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:17.453984  5417 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "31cfbbfec8d34499a9dceada863c4a86"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.454561  5417 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "31cfbbfec8d34499a9dceada863c4a86"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.459123  5417 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:02:17.461921  5435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.463158  5417 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:17.463282  5417 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "31cfbbfec8d34499a9dceada863c4a86"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.463392  5417 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:17.481508  5417 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:17.482196  5417 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:17.482360  5417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:17.482915  5417 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:17.483939  5417 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:17.483989  5417 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.484035  5417 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:17.484099  5417 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.494225  5417 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:45057
I20260812 08:02:17.494256  5574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:45057 every 8 connection(s)
I20260812 08:02:17.495245  5417 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:17.504426  5575 heartbeater.cc:344] Connected to a master server at 127.29.198.62:37705
I20260812 08:02:17.504698  5575 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:17.505259  5575 heartbeater.cc:507] Master 127.29.198.62:37705 requested a full tablet report, sending...
I20260812 08:02:17.505270 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 5417
I20260812 08:02:17.505406 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:17.506961  5346 ts_manager.cc:194] Registered new tserver with Master: 31cfbbfec8d34499a9dceada863c4a86 (127.29.198.1:45057)
I20260812 08:02:17.508162 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37705
--builtin_ntp_servers=127.29.198.20:41285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:17.508610  5346 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:44525
W20260812 08:02:17.616039  5579 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:17.616361  5579 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:17.616430  5579 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:17.616511  5579 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:17.619886  5579 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:17.619999  5579 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:17.620142  5579 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:02:17.623986  5579 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:41285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:37705
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.5579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:17.625151  5579 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:17.626297  5579 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:17.629222  5579 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:17.633322  5592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.633363  5586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:17.633657  5579 server_base.cc:1061] running on GCE node
W20260812 08:02:17.633322  5590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:17.634148  5579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:17.634727  5579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:17.635908  5579 hybrid_clock.cc:648] HybridClock initialized: now 1786521737635887 us; error 44 us; skew 500 ppm
I20260812 08:02:17.637699  5579 webserver.cc:533] Webserver started at http://127.29.198.2:36417/ using document root <none> and password file <none>
I20260812 08:02:17.638312  5579 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:17.638399  5579 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:17.638701  5579 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:17.640358  5579 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "0fcb93771a104532908731b4206432aa"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.640853  5579 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "0fcb93771a104532908731b4206432aa"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.644137  5579 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:17.646340  5598 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.647359  5579 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:17.647502  5579 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "0fcb93771a104532908731b4206432aa"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.647616  5579 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:17.666648  5579 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:17.667382  5579 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:17.667645  5579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:17.668356  5579 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:17.669421  5579 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:17.669469  5579 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.669545  5579 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:17.669586  5579 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.679560  5579 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:34911
I20260812 08:02:17.679586  5733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:34911 every 8 connection(s)
I20260812 08:02:17.680711  5579 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:17.685264 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 5579
I20260812 08:02:17.685369 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:17.687815 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:37705
--builtin_ntp_servers=127.29.198.20:41285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:17.690644  5734 heartbeater.cc:344] Connected to a master server at 127.29.198.62:37705
I20260812 08:02:17.690919  5734 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:17.691406  5734 heartbeater.cc:507] Master 127.29.198.62:37705 requested a full tablet report, sending...
I20260812 08:02:17.692481  5346 ts_manager.cc:194] Registered new tserver with Master: 0fcb93771a104532908731b4206432aa (127.29.198.2:34911)
I20260812 08:02:17.693077  5346 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:34401
W20260812 08:02:17.797458  5739 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:17.797757  5739 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:17.797827  5739 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:17.797912  5739 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:17.801389  5739 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:17.801499  5739 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:17.801625  5739 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:02:17.805660  5739 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:41285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:37705
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.5739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:17.807034  5739 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:17.808326  5739 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:17.811342  5739 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:17.815623  5747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.815618  5745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:17.815618  5744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:17.816311  5739 server_base.cc:1061] running on GCE node
I20260812 08:02:17.816701  5739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:17.817262  5739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:17.818418  5739 hybrid_clock.cc:648] HybridClock initialized: now 1786521737818397 us; error 34 us; skew 500 ppm
I20260812 08:02:17.820273  5739 webserver.cc:533] Webserver started at http://127.29.198.3:43267/ using document root <none> and password file <none>
I20260812 08:02:17.820863  5739 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:17.820920  5739 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:17.821132  5739 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:17.822727  5739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "5ffd18921f2e47fcb395b379900132c1"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.823210  5739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "5ffd18921f2e47fcb395b379900132c1"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.826644  5739 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 08:02:17.828883  5756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.830067  5739 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:17.830193  5739 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "5ffd18921f2e47fcb395b379900132c1"
format_stamp: "Formatted at 2026-08-12 08:02:17 on dist-test-slave-1zqn"
I20260812 08:02:17.830296  5739 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:17.857892  5739 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:17.858644  5739 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:17.858835  5739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:17.859480  5739 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:17.860591  5739 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:17.860663  5739 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.860733  5739 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:17.860780  5739 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:17.870877  5739 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:40691
I20260812 08:02:17.870906  5896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:40691 every 8 connection(s)
I20260812 08:02:17.871927  5739 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:17.875501 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 5739
I20260812 08:02:17.875635 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_0.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:17.881673  5897 heartbeater.cc:344] Connected to a master server at 127.29.198.62:37705
I20260812 08:02:17.882000  5897 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:17.882468  5897 heartbeater.cc:507] Master 127.29.198.62:37705 requested a full tablet report, sending...
I20260812 08:02:17.883422  5346 ts_manager.cc:194] Registered new tserver with Master: 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3:40691)
I20260812 08:02:17.883981  5346 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:51381
I20260812 08:02:17.889849 30488 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:17.907094  5346 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37136:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:02:17.925997  5651 tablet_service.cc:1511] Processing CreateTablet for tablet 97be769f029d44db8de2e889afb1d0a7 (DEFAULT_TABLE table=test-workload [id=fe1188f554ed4c059858794d5d13dc04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:17.926013  5496 tablet_service.cc:1511] Processing CreateTablet for tablet 97be769f029d44db8de2e889afb1d0a7 (DEFAULT_TABLE table=test-workload [id=fe1188f554ed4c059858794d5d13dc04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:17.926000  5813 tablet_service.cc:1511] Processing CreateTablet for tablet 97be769f029d44db8de2e889afb1d0a7 (DEFAULT_TABLE table=test-workload [id=fe1188f554ed4c059858794d5d13dc04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:17.926981  5651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97be769f029d44db8de2e889afb1d0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:17.926985  5813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97be769f029d44db8de2e889afb1d0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:17.926994  5496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97be769f029d44db8de2e889afb1d0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:17.932624  5921 tablet_bootstrap.cc:492] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: Bootstrap starting.
I20260812 08:02:17.933732  5923 tablet_bootstrap.cc:492] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: Bootstrap starting.
I20260812 08:02:17.933892  5924 tablet_bootstrap.cc:492] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1: Bootstrap starting.
I20260812 08:02:17.935703  5921 tablet_bootstrap.cc:654] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:17.935730  5923 tablet_bootstrap.cc:654] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:17.936146  5924 tablet_bootstrap.cc:654] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:17.936585  5923 log.cc:826] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:17.936677  5921 log.cc:826] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:17.936978  5924 log.cc:826] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:17.938403  5923 tablet_bootstrap.cc:492] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: No bootstrap required, opened a new log
I20260812 08:02:17.938432  5921 tablet_bootstrap.cc:492] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: No bootstrap required, opened a new log
I20260812 08:02:17.938644  5923 ts_tablet_manager.cc:1403] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:17.938656  5924 tablet_bootstrap.cc:492] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1: No bootstrap required, opened a new log
I20260812 08:02:17.938647  5921 ts_tablet_manager.cc:1403] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:17.938833  5924 ts_tablet_manager.cc:1403] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20260812 08:02:17.941793  5923 raft_consensus.cc:359] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.942029  5923 raft_consensus.cc:740] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31cfbbfec8d34499a9dceada863c4a86, State: Initialized, Role: FOLLOWER
I20260812 08:02:17.941931  5924 raft_consensus.cc:359] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.942149  5924 raft_consensus.cc:740] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffd18921f2e47fcb395b379900132c1, State: Initialized, Role: FOLLOWER
I20260812 08:02:17.942066  5921 raft_consensus.cc:359] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.942231  5921 raft_consensus.cc:740] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fcb93771a104532908731b4206432aa, State: Initialized, Role: FOLLOWER
I20260812 08:02:17.942453  5923 consensus_queue.cc:260] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.942458  5924 consensus_queue.cc:260] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.942514  5921 consensus_queue.cc:260] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.943439  5921 ts_tablet_manager.cc:1434] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 08:02:17.943427  5897 heartbeater.cc:499] Master 127.29.198.62:37705 was elected leader, sending a full tablet report...
I20260812 08:02:17.943452  5575 heartbeater.cc:499] Master 127.29.198.62:37705 was elected leader, sending a full tablet report...
I20260812 08:02:17.943439  5924 ts_tablet_manager.cc:1434] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:02:17.943830  5734 heartbeater.cc:499] Master 127.29.198.62:37705 was elected leader, sending a full tablet report...
I20260812 08:02:17.944681  5923 ts_tablet_manager.cc:1434] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 08:02:17.977218  5680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97be769f029d44db8de2e889afb1d0a7"
dest_uuid: "0fcb93771a104532908731b4206432aa"
 from {username='slave'} at 127.0.0.1:42814
I20260812 08:02:17.977471  5680 raft_consensus.cc:493] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:17.977571  5680 raft_consensus.cc:3060] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:17.978657  5680 raft_consensus.cc:515] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.979761  5680 leader_election.cc:290] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [CANDIDATE]: Term 1 election: Requested vote from peers 31cfbbfec8d34499a9dceada863c4a86 (127.29.198.1:45057), 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3:40691)
I20260812 08:02:17.983371 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:02:17.984215  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97be769f029d44db8de2e889afb1d0a7" candidate_uuid: "0fcb93771a104532908731b4206432aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5ffd18921f2e47fcb395b379900132c1"
I20260812 08:02:17.984484  5837 raft_consensus.cc:3060] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:17.984628  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97be769f029d44db8de2e889afb1d0a7" candidate_uuid: "0fcb93771a104532908731b4206432aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "31cfbbfec8d34499a9dceada863c4a86"
I20260812 08:02:17.984820  5522 raft_consensus.cc:3060] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:17.985854  5837 raft_consensus.cc:2468] T 97be769f029d44db8de2e889afb1d0a7 P 5ffd18921f2e47fcb395b379900132c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fcb93771a104532908731b4206432aa in term 1.
I20260812 08:02:17.986025  5522 raft_consensus.cc:2468] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fcb93771a104532908731b4206432aa in term 1.
I20260812 08:02:17.986334  5601 leader_election.cc:304] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fcb93771a104532908731b4206432aa, 5ffd18921f2e47fcb395b379900132c1; no voters: 
I20260812 08:02:17.986647  5934 raft_consensus.cc:2804] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:17.986886  5934 raft_consensus.cc:697] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 1 LEADER]: Becoming Leader. State: Replica: 0fcb93771a104532908731b4206432aa, State: Running, Role: LEADER
I20260812 08:02:17.987248  5934 consensus_queue.cc:237] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:17.990657  5346 catalog_manager.cc:5719] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fcb93771a104532908731b4206432aa (127.29.198.2). New cstate: current_term: 1 leader_uuid: "0fcb93771a104532908731b4206432aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } } }
W20260812 08:02:17.996323  5576 tablet.cc:2406] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:18.035712  5934 consensus_queue.cc:1048] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:18.042101  5944 consensus_queue.cc:1048] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:20.102591  5600 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.29.198.1:45057 timed out after 2.000s (SENT)
W20260812 08:02:22.105002  5600 consensus_peers.cc:597] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa -> Peer 31cfbbfec8d34499a9dceada863c4a86 (127.29.198.1:45057): Couldn't send request to peer 31cfbbfec8d34499a9dceada863c4a86. Status: Timed out: UpdateConsensus RPC to 127.29.198.1:45057 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:22.137961  5601 consensus_peers.cc:597] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa -> Peer 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3:40691): Couldn't send request to peer 5ffd18921f2e47fcb395b379900132c1. Status: Timed out: UpdateConsensus RPC to 127.29.198.3:40691 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:28.179134  5600 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.29.198.1:45057 timed out after 2.000s (SENT) [suppressed 3 similar messages]
I20260812 08:02:30.194463  5956 raft_consensus.cc:1012] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa: Attempting to remove follower 5ffd18921f2e47fcb395b379900132c1 from the Raft config. Reason: Leader has been unable to successfully communicate with peer 5ffd18921f2e47fcb395b379900132c1 for more than 3 seconds (12.107s)
I20260812 08:02:30.195214  5956 consensus_queue.cc:237] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } }
I20260812 08:02:30.196630  5520 raft_consensus.cc:1275] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 1 FOLLOWER]: Refusing update from remote peer 0fcb93771a104532908731b4206432aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:30.197062  5954 consensus_queue.cc:1048] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:30.199152  5956 raft_consensus.cc:2955] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } }
I20260812 08:02:30.199684  5520 raft_consensus.cc:2955] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } }
I20260812 08:02:30.202103  5346 catalog_manager.cc:5719] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa reported cstate change: config changed from index -1 to 2, VOTER 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3) evicted. New cstate: current_term: 1 leader_uuid: "0fcb93771a104532908731b4206432aa" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } }
I20260812 08:02:30.206034  5680 consensus_queue.cc:237] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } }
I20260812 08:02:30.207262  5520 raft_consensus.cc:1275] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 1 FOLLOWER]: Refusing update from remote peer 0fcb93771a104532908731b4206432aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:02:30.207625  5956 consensus_queue.cc:1048] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:02:30.209214  5954 raft_consensus.cc:2955] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } } }
I20260812 08:02:30.209671  5520 raft_consensus.cc:2955] T 97be769f029d44db8de2e889afb1d0a7 P 31cfbbfec8d34499a9dceada863c4a86 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } } }
I20260812 08:02:30.210697  5324 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:VOTER RPC for tablet 97be769f029d44db8de2e889afb1d0a7 with cas_config_opid_index 2: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260812 08:02:30.211622  5346 catalog_manager.cc:5719] T 97be769f029d44db8de2e889afb1d0a7 P 0fcb93771a104532908731b4206432aa reported cstate change: config changed from index 2 to 3, VOTER 5ffd18921f2e47fcb395b379900132c1 (127.29.198.3) added. New cstate: current_term: 1 leader_uuid: "0fcb93771a104532908731b4206432aa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0fcb93771a104532908731b4206432aa" member_type: VOTER last_known_addr { host: "127.29.198.2" port: 34911 } } peers { permanent_uuid: "31cfbbfec8d34499a9dceada863c4a86" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 45057 } } peers { permanent_uuid: "5ffd18921f2e47fcb395b379900132c1" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 40691 } } }
W20260812 08:02:30.247344  5601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:30.251099 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 5417
I20260812 08:02:30.263435 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 5579
I20260812 08:02:30.273756 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 5739
W20260812 08:02:30.285104  5328 connection.cc:573] client connection to 127.29.198.3:40691 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:30.285305  5328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:30.285393 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 5308
2026-08-12T08:02:30Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/0 (13234 ms)
[ RUN      ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/1
2026-08-12T08:02:30Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:30Z Disabled control of system clock
I20260812 08:02:30.320458 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:34367
--webserver_interface=127.29.198.62
--webserver_port=0
--builtin_ntp_servers=127.29.198.20:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.198.62:34367
--raft_prepare_replacement_before_eviction=true
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:30.425376  5969 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:30.425611  5969 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:30.425652  5969 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:30.429030  5969 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:30.429100  5969 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:30.429121  5969 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:30.429140  5969 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:30.432973  5969 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.29.198.62:34367
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.198.62:34367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.198.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.5969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:30.434082  5969 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:30.435199  5969 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:30.441007  5979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.441007  5975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.441067  5976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:30.441311  5969 server_base.cc:1061] running on GCE node
I20260812 08:02:30.441856  5969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:30.442848  5969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:30.444033  5969 hybrid_clock.cc:648] HybridClock initialized: now 1786521750444010 us; error 40 us; skew 500 ppm
I20260812 08:02:30.445984  5969 webserver.cc:533] Webserver started at http://127.29.198.62:34809/ using document root <none> and password file <none>
I20260812 08:02:30.446614  5969 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:30.446702  5969 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:30.446939  5969 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:30.448724  5969 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data/instance:
uuid: "71eac6b7e2d2489f8f3f0c7565e0a443"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.449241  5969 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal/instance:
uuid: "71eac6b7e2d2489f8f3f0c7565e0a443"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.452751  5969 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:30.455197  5985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.456295  5969 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:30.456439  5969 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal
uuid: "71eac6b7e2d2489f8f3f0c7565e0a443"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.456565  5969 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:30.467367  5969 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:30.468212  5969 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:30.468415  5969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:30.476217  5969 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.62:34367
I20260812 08:02:30.476240  6050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.62:34367 every 8 connection(s)
I20260812 08:02:30.477272  5969 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:30.480337  6051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:30.485437  6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443: Bootstrap starting.
I20260812 08:02:30.485841 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 5969
I20260812 08:02:30.485961 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/master-0/wal/instance
I20260812 08:02:30.488229  6051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:30.489010  6051 log.cc:826] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:30.490625  6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443: No bootstrap required, opened a new log
I20260812 08:02:30.493355  6051 raft_consensus.cc:359] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 34367 } }
I20260812 08:02:30.493584  6051 raft_consensus.cc:385] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:30.493678  6051 raft_consensus.cc:740] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eac6b7e2d2489f8f3f0c7565e0a443, State: Initialized, Role: FOLLOWER
I20260812 08:02:30.494153  6051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 34367 } }
I20260812 08:02:30.494326  6051 raft_consensus.cc:399] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:30.494390  6051 raft_consensus.cc:493] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:30.494498  6051 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:30.495493  6051 raft_consensus.cc:515] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 34367 } }
I20260812 08:02:30.495810  6051 leader_election.cc:304] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71eac6b7e2d2489f8f3f0c7565e0a443; no voters: 
I20260812 08:02:30.496043  6051 leader_election.cc:290] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:30.496207  6057 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:30.496447  6057 raft_consensus.cc:697] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [term 1 LEADER]: Becoming Leader. State: Replica: 71eac6b7e2d2489f8f3f0c7565e0a443, State: Running, Role: LEADER
I20260812 08:02:30.496717  6057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 34367 } }
I20260812 08:02:30.497239  6051 sys_catalog.cc:565] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:30.498271  6059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 34367 } } }
I20260812 08:02:30.498412  6059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:30.498847  6067 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:30.499404  6060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71eac6b7e2d2489f8f3f0c7565e0a443. Latest consensus state: current_term: 1 leader_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71eac6b7e2d2489f8f3f0c7565e0a443" member_type: VOTER last_known_addr { host: "127.29.198.62" port: 34367 } } }
I20260812 08:02:30.499496  6060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:30.501739  6067 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:30.506943  6067 catalog_manager.cc:1383] Generated new cluster ID: d8471b0d26db490eab461bd5e1dff66d
I20260812 08:02:30.507014  6067 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:30.514933  6067 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:30.515723  6067 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:30.521237  6067 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 71eac6b7e2d2489f8f3f0c7565e0a443: Generated new TSK 0
I20260812 08:02:30.521832  6067 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:30.529620 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.1:0
--local_ip_for_outbound_sockets=127.29.198.1
--webserver_interface=127.29.198.1
--webserver_port=0
--tserver_master_addrs=127.29.198.62:34367
--builtin_ntp_servers=127.29.198.20:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
W20260812 08:02:30.638662  6084 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:30.638923  6084 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:30.638974  6084 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:30.639058  6084 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:30.642474  6084 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:30.642639  6084 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.1
I20260812 08:02:30.646498  6084 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.198.1
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:34367
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.6084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:30.647547  6084 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:30.648794  6084 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:30.651485  6084 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:30.655213  6089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.655220  6090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.655223  6093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:30.656306  6084 server_base.cc:1061] running on GCE node
I20260812 08:02:30.656735  6084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:30.657343  6084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:30.658535  6084 hybrid_clock.cc:648] HybridClock initialized: now 1786521750658511 us; error 37 us; skew 500 ppm
I20260812 08:02:30.660856  6084 webserver.cc:533] Webserver started at http://127.29.198.1:38845/ using document root <none> and password file <none>
I20260812 08:02:30.661686  6084 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:30.661772  6084 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:30.662002  6084 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:30.664081  6084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data/instance:
uuid: "895f6027883f4112b456263f3a0232d3"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.664680  6084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance:
uuid: "895f6027883f4112b456263f3a0232d3"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.668948  6084 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:30.671720  6100 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.672957  6084 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:30.673082  6084 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
uuid: "895f6027883f4112b456263f3a0232d3"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.673224  6084 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:30.695680  6084 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:30.696529  6084 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:30.696688  6084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:30.697209  6084 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:30.698166  6084 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:30.698215  6084 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.698316  6084 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:30.698355  6084 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.708146  6084 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.1:32963
I20260812 08:02:30.708250  6243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.1:32963 every 8 connection(s)
I20260812 08:02:30.709165  6084 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:30.716897 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 6084
I20260812 08:02:30.717065 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:30.717895  6245 heartbeater.cc:344] Connected to a master server at 127.29.198.62:34367
I20260812 08:02:30.718148  6245 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:30.718776  6245 heartbeater.cc:507] Master 127.29.198.62:34367 requested a full tablet report, sending...
I20260812 08:02:30.719578 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.2:0
--local_ip_for_outbound_sockets=127.29.198.2
--webserver_interface=127.29.198.2
--webserver_port=0
--tserver_master_addrs=127.29.198.62:34367
--builtin_ntp_servers=127.29.198.20:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:30.720404  6004 ts_manager.cc:194] Registered new tserver with Master: 895f6027883f4112b456263f3a0232d3 (127.29.198.1:32963)
I20260812 08:02:30.721546  6004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.1:57247
W20260812 08:02:30.830273  6248 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:30.830519  6248 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:30.830541  6248 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:30.830586  6248 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:30.833978  6248 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:30.834095  6248 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.2
I20260812 08:02:30.838129  6248 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.198.2
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:34367
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.6248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:30.839308  6248 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:30.840524  6248 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:30.843299  6248 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:30.847254  6256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.847301  6253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.847301  6254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:30.847852  6248 server_base.cc:1061] running on GCE node
I20260812 08:02:30.848287  6248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:30.848814  6248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:30.850015  6248 hybrid_clock.cc:648] HybridClock initialized: now 1786521750850001 us; error 26 us; skew 500 ppm
I20260812 08:02:30.851866  6248 webserver.cc:533] Webserver started at http://127.29.198.2:34783/ using document root <none> and password file <none>
I20260812 08:02:30.852488  6248 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:30.852547  6248 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:30.852808  6248 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:30.854336  6248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data/instance:
uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.854809  6248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance:
uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.858237  6248 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:30.860432  6263 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.861545  6248 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:30.861670  6248 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e"
format_stamp: "Formatted at 2026-08-12 08:02:30 on dist-test-slave-1zqn"
I20260812 08:02:30.861764  6248 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:30.876988  6248 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:30.877707  6248 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:30.877908  6248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:30.878504  6248 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:30.879650  6248 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:30.879699  6248 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.879771  6248 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:30.879817  6248 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.889496  6248 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.2:33625
I20260812 08:02:30.889531  6405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.2:33625 every 8 connection(s)
I20260812 08:02:30.890487  6248 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:30.896919 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 6248
I20260812 08:02:30.897065 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:30.899741 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.3:0
--local_ip_for_outbound_sockets=127.29.198.3
--webserver_interface=127.29.198.3
--webserver_port=0
--tserver_master_addrs=127.29.198.62:34367
--builtin_ntp_servers=127.29.198.20:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:30.900264  6406 heartbeater.cc:344] Connected to a master server at 127.29.198.62:34367
I20260812 08:02:30.900527  6406 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:30.901146  6406 heartbeater.cc:507] Master 127.29.198.62:34367 requested a full tablet report, sending...
I20260812 08:02:30.902248  6004 ts_manager.cc:194] Registered new tserver with Master: d5bd9ba1d9024e3b9d8ced50c5525a3e (127.29.198.2:33625)
I20260812 08:02:30.902808  6004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.2:34655
W20260812 08:02:31.007604  6410 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:31.007845  6410 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:31.007894  6410 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:31.007994  6410 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:31.011505  6410 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:31.011658  6410 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.3
I20260812 08:02:31.015911  6410 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.198.3
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:34367
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.6410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:31.017118  6410 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:31.018273  6410 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:31.021203  6410 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:31.025342  6416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:31.025381  6419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:31.025355  6415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:31.025585  6410 server_base.cc:1061] running on GCE node
I20260812 08:02:31.026011  6410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:31.026561  6410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:31.027730  6410 hybrid_clock.cc:648] HybridClock initialized: now 1786521751027744 us; error 76 us; skew 500 ppm
I20260812 08:02:31.029618  6410 webserver.cc:533] Webserver started at http://127.29.198.3:34485/ using document root <none> and password file <none>
I20260812 08:02:31.030195  6410 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:31.030251  6410 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:31.030407  6410 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:31.031899  6410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data/instance:
uuid: "df15462b8d5f4a6499785a2af219d192"
format_stamp: "Formatted at 2026-08-12 08:02:31 on dist-test-slave-1zqn"
I20260812 08:02:31.032435  6410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance:
uuid: "df15462b8d5f4a6499785a2af219d192"
format_stamp: "Formatted at 2026-08-12 08:02:31 on dist-test-slave-1zqn"
I20260812 08:02:31.035727  6410 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:31.038070  6425 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.039292  6410 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:31.039479  6410 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
uuid: "df15462b8d5f4a6499785a2af219d192"
format_stamp: "Formatted at 2026-08-12 08:02:31 on dist-test-slave-1zqn"
I20260812 08:02:31.039608  6410 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:31.073393  6410 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:31.074234  6410 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:31.074499  6410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:31.075228  6410 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:31.076445  6410 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:31.076534  6410 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.076617  6410 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:31.076689  6410 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.088178  6410 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.3:33471
I20260812 08:02:31.088235  6567 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.3:33471 every 8 connection(s)
I20260812 08:02:31.089318  6410 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:31.097524 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 6410
I20260812 08:02:31.097661 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:31.098234  6568 heartbeater.cc:344] Connected to a master server at 127.29.198.62:34367
I20260812 08:02:31.098492  6568 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:31.099057  6568 heartbeater.cc:507] Master 127.29.198.62:34367 requested a full tablet report, sending...
I20260812 08:02:31.100262 30488 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
/tmp/dist-test-taskP7h5r1/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.198.4:0
--local_ip_for_outbound_sockets=127.29.198.4
--webserver_interface=127.29.198.4
--webserver_port=0
--tserver_master_addrs=127.29.198.62:34367
--builtin_ntp_servers=127.29.198.20:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--follower_unavailable_considered_failed_sec=3
--consensus_rpc_timeout_ms=2000
--heartbeat_interval_ms=6000
--update_tablet_stats_interval_ms=7000
--raft_heartbeat_interval_ms=50
--enable_leader_failure_detection=false with env {}
I20260812 08:02:31.100289  6004 ts_manager.cc:194] Registered new tserver with Master: df15462b8d5f4a6499785a2af219d192 (127.29.198.3:33471)
I20260812 08:02:31.101001  6004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.3:36089
W20260812 08:02:31.208098  6571 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:31.208335  6571 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:31.208359  6571 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:31.208406  6571 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:31.211830  6571 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:31.211941  6571 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.198.4
I20260812 08:02:31.215725  6571 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.198.20:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=2000
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.198.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.29.198.4
--webserver_port=0
--heartbeat_interval_ms=6000
--tserver_master_addrs=127.29.198.62:34367
--update_tablet_stats_interval_ms=7000
--never_fsync=true
--heap_profile_path=/tmp/kudu.6571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.198.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:31.216781  6571 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:31.217850  6571 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:02:31.221026  6571 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:02:31.224776  6581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:31.224843  6578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:31.224962  6579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:31.225248  6571 server_base.cc:1061] running on GCE node
I20260812 08:02:31.225551  6571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:31.226022  6571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:31.227185  6571 hybrid_clock.cc:648] HybridClock initialized: now 1786521751227169 us; error 32 us; skew 500 ppm
I20260812 08:02:31.228940  6571 webserver.cc:533] Webserver started at http://127.29.198.4:40733/ using document root <none> and password file <none>
I20260812 08:02:31.229526  6571 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:31.229584  6571 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:31.229737  6571 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:31.231289  6571 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data/instance:
uuid: "d51d5f3bd8c14a8991046054766ba9ac"
format_stamp: "Formatted at 2026-08-12 08:02:31 on dist-test-slave-1zqn"
I20260812 08:02:31.231714  6571 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance:
uuid: "d51d5f3bd8c14a8991046054766ba9ac"
format_stamp: "Formatted at 2026-08-12 08:02:31 on dist-test-slave-1zqn"
I20260812 08:02:31.235073  6571 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:31.237239  6587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.238443  6571 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:31.238544  6571 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data,/tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
uuid: "d51d5f3bd8c14a8991046054766ba9ac"
format_stamp: "Formatted at 2026-08-12 08:02:31 on dist-test-slave-1zqn"
I20260812 08:02:31.238639  6571 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:31.257426  6571 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:31.258111  6571 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:31.258258  6571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:31.258803  6571 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:31.259793  6571 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:31.259842  6571 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.259882  6571 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:31.259912  6571 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.270620  6571 rpc_server.cc:307] RPC server started. Bound to: 127.29.198.4:45897
I20260812 08:02:31.270655  6733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.198.4:45897 every 8 connection(s)
I20260812 08:02:31.271660  6571 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/data/info.pb
I20260812 08:02:31.277670 30488 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu as pid 6571
I20260812 08:02:31.277815 30488 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskP7h5r1/test-tmp/tablet_replacement-itest.0.DontEvictIfRemainingConfigIsUnstableITest.NodesStopped_1.1786521667469487-30488-0/minicluster-data/ts-3/wal/instance
I20260812 08:02:31.280906  6736 heartbeater.cc:344] Connected to a master server at 127.29.198.62:34367
I20260812 08:02:31.281209  6736 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:31.281680  6736 heartbeater.cc:507] Master 127.29.198.62:34367 requested a full tablet report, sending...
I20260812 08:02:31.282640  6004 ts_manager.cc:194] Registered new tserver with Master: d51d5f3bd8c14a8991046054766ba9ac (127.29.198.4:45897)
I20260812 08:02:31.283128  6004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.198.4:56721
I20260812 08:02:31.292572 30488 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 08:02:31.309993  6004 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42818:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:02:31.328217  6162 tablet_service.cc:1511] Processing CreateTablet for tablet 7601393541f64015bf16a41e45de2197 (DEFAULT_TABLE table=test-workload [id=733bf7f0354440ee95f982ce576e8503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:31.328276  6649 tablet_service.cc:1511] Processing CreateTablet for tablet 7601393541f64015bf16a41e45de2197 (DEFAULT_TABLE table=test-workload [id=733bf7f0354440ee95f982ce576e8503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:31.328276  6482 tablet_service.cc:1511] Processing CreateTablet for tablet 7601393541f64015bf16a41e45de2197 (DEFAULT_TABLE table=test-workload [id=733bf7f0354440ee95f982ce576e8503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:31.329173  6162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601393541f64015bf16a41e45de2197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:31.329203  6649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601393541f64015bf16a41e45de2197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:31.329203  6482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601393541f64015bf16a41e45de2197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:31.334024  6759 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: Bootstrap starting.
I20260812 08:02:31.335337  6760 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192: Bootstrap starting.
I20260812 08:02:31.336129  6761 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac: Bootstrap starting.
I20260812 08:02:31.336673  6759 tablet_bootstrap.cc:654] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:31.337425  6760 tablet_bootstrap.cc:654] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:31.337579  6759 log.cc:826] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:31.338172  6761 tablet_bootstrap.cc:654] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:31.338270  6760 log.cc:826] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:31.339026  6761 log.cc:826] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:31.339548  6759 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: No bootstrap required, opened a new log
I20260812 08:02:31.339761  6759 ts_tablet_manager.cc:1403] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:31.339890  6760 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192: No bootstrap required, opened a new log
I20260812 08:02:31.340109  6760 ts_tablet_manager.cc:1403] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:31.340677  6761 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac: No bootstrap required, opened a new log
I20260812 08:02:31.340848  6761 ts_tablet_manager.cc:1403] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:31.342574  6759 raft_consensus.cc:359] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.342808  6759 raft_consensus.cc:740] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895f6027883f4112b456263f3a0232d3, State: Initialized, Role: FOLLOWER
I20260812 08:02:31.343129  6759 consensus_queue.cc:260] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.343144  6760 raft_consensus.cc:359] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.343353  6760 raft_consensus.cc:740] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df15462b8d5f4a6499785a2af219d192, State: Initialized, Role: FOLLOWER
I20260812 08:02:31.343643  6760 consensus_queue.cc:260] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.343888  6761 raft_consensus.cc:359] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.344045  6759 ts_tablet_manager.cc:1434] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:31.344115  6761 raft_consensus.cc:740] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51d5f3bd8c14a8991046054766ba9ac, State: Initialized, Role: FOLLOWER
I20260812 08:02:31.344427  6245 heartbeater.cc:499] Master 127.29.198.62:34367 was elected leader, sending a full tablet report...
I20260812 08:02:31.344511  6568 heartbeater.cc:499] Master 127.29.198.62:34367 was elected leader, sending a full tablet report...
I20260812 08:02:31.344626  6760 ts_tablet_manager.cc:1434] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.001s
I20260812 08:02:31.344393  6761 consensus_queue.cc:260] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.346064  6736 heartbeater.cc:499] Master 127.29.198.62:34367 was elected leader, sending a full tablet report...
I20260812 08:02:31.346170  6761 ts_tablet_manager.cc:1434] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260812 08:02:31.384675  6191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7601393541f64015bf16a41e45de2197"
dest_uuid: "895f6027883f4112b456263f3a0232d3"
 from {username='slave'} at 127.0.0.1:48984
I20260812 08:02:31.385085  6191 raft_consensus.cc:493] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:31.385250  6191 raft_consensus.cc:3060] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:31.386252  6191 raft_consensus.cc:515] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.387352  6191 leader_election.cc:290] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [CANDIDATE]: Term 1 election: Requested vote from peers d51d5f3bd8c14a8991046054766ba9ac (127.29.198.4:45897), df15462b8d5f4a6499785a2af219d192 (127.29.198.3:33471)
I20260812 08:02:31.390655 30488 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 0.0 0.0
I20260812 08:02:31.392591  6510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601393541f64015bf16a41e45de2197" candidate_uuid: "895f6027883f4112b456263f3a0232d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "df15462b8d5f4a6499785a2af219d192"
I20260812 08:02:31.392603  6671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601393541f64015bf16a41e45de2197" candidate_uuid: "895f6027883f4112b456263f3a0232d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d51d5f3bd8c14a8991046054766ba9ac"
I20260812 08:02:31.392794  6671 raft_consensus.cc:3060] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:31.392820  6510 raft_consensus.cc:3060] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:31.393755  6671 raft_consensus.cc:2468] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895f6027883f4112b456263f3a0232d3 in term 1.
I20260812 08:02:31.393929  6510 raft_consensus.cc:2468] T 7601393541f64015bf16a41e45de2197 P df15462b8d5f4a6499785a2af219d192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 895f6027883f4112b456263f3a0232d3 in term 1.
I20260812 08:02:31.394297  6108 leader_election.cc:304] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 895f6027883f4112b456263f3a0232d3, d51d5f3bd8c14a8991046054766ba9ac; no voters: 
I20260812 08:02:31.394629  6765 raft_consensus.cc:2804] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:31.394876  6765 raft_consensus.cc:697] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: Becoming Leader. State: Replica: 895f6027883f4112b456263f3a0232d3, State: Running, Role: LEADER
I20260812 08:02:31.395272  6765 consensus_queue.cc:237] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:31.398828  6002 catalog_manager.cc:5719] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 895f6027883f4112b456263f3a0232d3 (127.29.198.1). New cstate: current_term: 1 leader_uuid: "895f6027883f4112b456263f3a0232d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:31.448747  6765 consensus_queue.cc:1048] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:31.453317  6765 consensus_queue.cc:1048] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:33.514189  6108 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.29.198.4:45897 timed out after 2.000s (SENT)
W20260812 08:02:35.516445  6108 consensus_peers.cc:597] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 -> Peer d51d5f3bd8c14a8991046054766ba9ac (127.29.198.4:45897): Couldn't send request to peer d51d5f3bd8c14a8991046054766ba9ac. Status: Timed out: UpdateConsensus RPC to 127.29.198.4:45897 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:35.520387  6787 consensus_queue.cc:579] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Leader has been unable to successfully communicate with peer d51d5f3bd8c14a8991046054766ba9ac for more than 3 seconds (4.065s)
I20260812 08:02:35.524121  6191 consensus_queue.cc:237] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } } peers { permanent_uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e" member_type: NON_VOTER last_known_addr { host: "127.29.198.2" port: 33625 } attrs { promote: true } }
W20260812 08:02:35.530354  6102 consensus_peers.cc:597] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 -> Peer d5bd9ba1d9024e3b9d8ced50c5525a3e (127.29.198.2:33625): Couldn't send request to peer d5bd9ba1d9024e3b9d8ced50c5525a3e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7601393541f64015bf16a41e45de2197. This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:35.536638  6107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.565125  6794 ts_tablet_manager.cc:933] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Initiating tablet copy from peer 895f6027883f4112b456263f3a0232d3 (127.29.198.1:32963)
I20260812 08:02:35.565752  6794 tablet_copy_client.cc:323] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.198.1:32963
W20260812 08:02:35.566185  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.570358  6212 tablet_copy_service.cc:140] P 895f6027883f4112b456263f3a0232d3: Received BeginTabletCopySession request for tablet 7601393541f64015bf16a41e45de2197 from peer d5bd9ba1d9024e3b9d8ced50c5525a3e ({username='slave'} at 127.29.198.2:37631)
I20260812 08:02:35.570505  6212 tablet_copy_service.cc:161] P 895f6027883f4112b456263f3a0232d3: Beginning new tablet copy session on tablet 7601393541f64015bf16a41e45de2197 from peer d5bd9ba1d9024e3b9d8ced50c5525a3e at {username='slave'} at 127.29.198.2:37631: session id = d5bd9ba1d9024e3b9d8ced50c5525a3e-7601393541f64015bf16a41e45de2197
I20260812 08:02:35.571658  6212 tablet_copy_source_session.cc:215] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:35.575613  6794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601393541f64015bf16a41e45de2197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.581307  6794 tablet_copy_client.cc:806] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:35.581557  6794 tablet_copy_client.cc:670] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:35.583819  6794 tablet_copy_client.cc:538] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:35.585744  6794 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Bootstrap starting.
I20260812 08:02:35.590574  6794 log.cc:826] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:35.593083  6794 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:35.593480  6794 tablet_bootstrap.cc:492] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Bootstrap complete.
I20260812 08:02:35.593787  6794 ts_tablet_manager.cc:1403] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Time spent bootstrapping tablet: real 0.008s	user 0.003s	sys 0.004s
I20260812 08:02:35.596578  6794 raft_consensus.cc:359] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } }
I20260812 08:02:35.597070  6794 raft_consensus.cc:740] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d5bd9ba1d9024e3b9d8ced50c5525a3e, State: Initialized, Role: LEARNER
I20260812 08:02:35.597393  6794 consensus_queue.cc:260] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } } peers { permanent_uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e" member_type: NON_VOTER last_known_addr { host: "127.29.198.2" port: 33625 } attrs { promote: true } }
I20260812 08:02:35.598250  6406 heartbeater.cc:499] Master 127.29.198.62:34367 was elected leader, sending a full tablet report...
I20260812 08:02:35.598340  6794 ts_tablet_manager.cc:1434] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:02:35.599359  6212 tablet_copy_service.cc:342] P 895f6027883f4112b456263f3a0232d3: Request end of tablet copy session d5bd9ba1d9024e3b9d8ced50c5525a3e-7601393541f64015bf16a41e45de2197 received from {username='slave'} at 127.29.198.2:37631
I20260812 08:02:35.599551  6212 tablet_copy_service.cc:434] P 895f6027883f4112b456263f3a0232d3: ending tablet copy session d5bd9ba1d9024e3b9d8ced50c5525a3e-7601393541f64015bf16a41e45de2197 on tablet 7601393541f64015bf16a41e45de2197 with peer d5bd9ba1d9024e3b9d8ced50c5525a3e
W20260812 08:02:35.619910  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.619933  6345 raft_consensus.cc:1217] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260812 08:02:35.657531  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.682147  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:35.711530  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.742010  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:35.763509  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.788130  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:35.816112  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.826831  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:35.865890  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.878841  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:35.903489  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.932401  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:35.953474  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:35.982649  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.008389  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.042532  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.065330  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.097443  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.114318  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.158386  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.169207  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.216359  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.231419  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.263928  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.285385  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.319332  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.326089  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.362984  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.376799  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.419693  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.420753  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.464190  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.471568  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.522099  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.525658  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.577119  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.585772  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.615702  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.647109  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.670805  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.696120  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.727563  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.751118  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.779549  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.799539  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.819211  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.848348  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.869304  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.886462  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.907958  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.948505  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:36.954909  6790 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:36.987567  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.006925  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.037573  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.065022  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.078681  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.108001  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.116454  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.152433  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.163341  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.199290  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.224515  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.254191  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.270632  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.310333  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.330869  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.362545  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.382062  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.418777  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.439771  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.456213  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.483861  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.499382  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.539458  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.553581  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.578357  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.607954  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.625411  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.650492  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.681459  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.696470  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.733507  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.750793  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.793692  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.811697  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.850777  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.859298  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.890867  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.919507  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.947906  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.970964  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:37.995034  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.015771  6789 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.056169  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.070328  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.108166  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.117487  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.147913  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.161546  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:38.201212  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.205917  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:38.259783  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.263262  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:38.302363  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.307977  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.353453  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.353749  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:38.403882  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.413147  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.452977  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.472745  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:38.512862  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.514011  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:38.553965  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.573468  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.602910  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.620827  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.660887  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.674484  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.720093  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.723405  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.773106  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.782739  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.824335  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.828776  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.872334  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.875478  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:38.923736  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.930567  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.969565  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:38.990018  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.025651  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.043021  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.086687  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.098080  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.126281  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.154037  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.187405  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.203140  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.241271  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.251053  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:39.300143  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.301566  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.345330  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.354640  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.398553  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.414608  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.458004  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.461453  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.516393  6108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:39.520455  6804 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:39.528724  6106 consensus_peers.cc:597] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 -> Peer df15462b8d5f4a6499785a2af219d192 (127.29.198.3:33471): Couldn't send request to peer df15462b8d5f4a6499785a2af219d192. Status: Timed out: UpdateConsensus RPC to 127.29.198.3:33471 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:39.529044  6108 consensus_peers.cc:597] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 -> Peer d51d5f3bd8c14a8991046054766ba9ac (127.29.198.4:45897): Couldn't send request to peer d51d5f3bd8c14a8991046054766ba9ac. Status: Timed out: UpdateConsensus RPC to 127.29.198.4:45897 timed out after 2.000s (SENT). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:39.531260  6804 consensus_queue.cc:579] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Leader has been unable to successfully communicate with peer d51d5f3bd8c14a8991046054766ba9ac for more than 3 seconds (4.007s)
I20260812 08:02:39.551640  6805 consensus_queue.cc:579] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [LEADER]: Leader has been unable to successfully communicate with peer df15462b8d5f4a6499785a2af219d192 for more than 3 seconds (4.027s)
I20260812 08:02:39.559484  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.601622  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.654191  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.695993  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.737761  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.776527  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.826294  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.887006  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.941128  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:39.986675  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.029750  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.074281  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.133708  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.184983  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.241811  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.293787  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.334319  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.374362  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.418416  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.479570  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.526561  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.580562  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.634286  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.679361  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.717700  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.779145  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.831521  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.871773  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.910844  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.948452  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:40.994190  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.048174  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.098429  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.159405  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.198523  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.250402  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.300330  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.352212  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.392402  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.440986  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.481845  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260812 08:02:41.533599  6108 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.29.198.4:45897 timed out after 2.000s (SENT) [suppressed 4 similar messages]
I20260812 08:02:41.541814  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.589602  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.646214  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.691272  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.753201  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.806499  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.851456  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.902994  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:41.961087  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.011855  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.071684  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.130738  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.170710  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.216787  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.270190  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.326279  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.383131  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.443526  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.490100  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.537163  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.585978  6802 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.638041  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.698431  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.758507  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.804171  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.857936  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.900563  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:42.943254  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.005632  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.049326  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.092118  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.135681  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.194896  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.252820  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.310653  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.367870  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.426267  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.466626  6808 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.509527  6805 raft_consensus.cc:1027] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: attempt to promote peer d5bd9ba1d9024e3b9d8ced50c5525a3e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260812 08:02:43.520996  6666 raft_consensus.cc:1275] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 1 FOLLOWER]: Refusing update from remote peer 895f6027883f4112b456263f3a0232d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:43.521642  6668 raft_consensus.cc:1275] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 1 FOLLOWER]: Refusing update from remote peer 895f6027883f4112b456263f3a0232d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:43.523025  6665 raft_consensus.cc:1217] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260812 08:02:43.523983  6808 raft_consensus.cc:2955] T 7601393541f64015bf16a41e45de2197 P 895f6027883f4112b456263f3a0232d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d5bd9ba1d9024e3b9d8ced50c5525a3e (127.29.198.2) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } } peers { permanent_uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e" member_type: NON_VOTER last_known_addr { host: "127.29.198.2" port: 33625 } attrs { promote: true } } }
I20260812 08:02:43.524417  6665 raft_consensus.cc:2955] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d5bd9ba1d9024e3b9d8ced50c5525a3e (127.29.198.2) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } } peers { permanent_uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e" member_type: NON_VOTER last_known_addr { host: "127.29.198.2" port: 33625 } attrs { promote: true } } }
I20260812 08:02:43.526271  6808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48976 (request call id 1) took 8003 ms. Trace:
I20260812 08:02:43.526383  6808 rpcz_store.cc:276] 0812 08:02:35.523293 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:35.523398 (+   105us) service_pool.cc:224] Handling call
0812 08:02:35.525113 (+  1715us) log.cc:844] Serialized 495 byte log entry
0812 08:02:43.526256 (+8001143us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":67,"mutex_wait_us":33,"raft.queue_time_us":239,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":1094,"spinlock_wait_cycles":73088,"thread_start_us":80,"threads_started":1,"wal-append.queue_time_us":195,"wal-append.run_cpu_time_us":413,"wal-append.run_wall_time_us":1000498}
I20260812 08:02:43.527223  5986 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 7601393541f64015bf16a41e45de2197 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 08:02:43.527535  6000 catalog_manager.cc:5719] T 7601393541f64015bf16a41e45de2197 P d51d5f3bd8c14a8991046054766ba9ac reported cstate change: config changed from index -1 to 2, NON_VOTER d5bd9ba1d9024e3b9d8ced50c5525a3e (127.29.198.2) added. New cstate: current_term: 1 leader_uuid: "895f6027883f4112b456263f3a0232d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } } peers { permanent_uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e" member_type: NON_VOTER last_known_addr { host: "127.29.198.2" port: 33625 } attrs { promote: true } } }
I20260812 08:02:43.529274  6345 raft_consensus.cc:2955] T 7601393541f64015bf16a41e45de2197 P d5bd9ba1d9024e3b9d8ced50c5525a3e [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d5bd9ba1d9024e3b9d8ced50c5525a3e (127.29.198.2) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "895f6027883f4112b456263f3a0232d3" member_type: VOTER last_known_addr { host: "127.29.198.1" port: 32963 } } peers { permanent_uuid: "d51d5f3bd8c14a8991046054766ba9ac" member_type: VOTER last_known_addr { host: "127.29.198.4" port: 45897 } } peers { permanent_uuid: "df15462b8d5f4a6499785a2af219d192" member_type: VOTER last_known_addr { host: "127.29.198.3" port: 33471 } } peers { permanent_uuid: "d5bd9ba1d9024e3b9d8ced50c5525a3e" member_type: NON_VOTER last_known_addr { host: "127.29.198.2" port: 33625 } attrs { promote: true } } }
I20260812 08:02:43.529983 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 6084
W20260812 08:02:43.547168  6264 connection.cc:573] server connection from 127.29.198.1:54555 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:43.547478  5987 connection.cc:573] server connection from 127.29.198.1:57247 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:43.547740 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 6248
I20260812 08:02:43.559666 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 6410
I20260812 08:02:43.570675 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 6571
I20260812 08:02:43.581910 30488 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskP7h5r1/build/debug/bin/kudu with pid 5969
2026-08-12T08:02:43Z chronyd exiting
[       OK ] DontEvictIfRemainingConfigIsUnstableITest.NodesStopped/1 (13301 ms)
[----------] 4 tests from DontEvictIfRemainingConfigIsUnstableITest (53466 ms total)

[----------] Global test environment tear-down
[==========] 10 tests from 3 test suites ran. (96130 ms total)
[  PASSED  ] 10 tests.
