Note: This is test shard 1 of 6.
[==========] Running 5 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 4 tests from TabletCopyITest
[ RUN      ] TabletCopyITest.TestRejectRogueLeader
2026-08-12T08:01:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:56Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:01:56.727334  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:43545
--webserver_interface=127.8.228.62
--webserver_port=0
--builtin_ntp_servers=127.8.228.20:39889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:43545
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:01:56.827693  9118 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:56.827874  9118 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:56.827910  9118 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:56.831015  9118 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:56.831061  9118 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:56.831079  9118 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:56.831103  9118 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:56.834707  9118 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:39889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:43545
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:43545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:56.835525  9118 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:56.836479  9118 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:56.842945  9131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.842888  9129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.843298  9134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:56.843386  9118 server_base.cc:1061] running on GCE node
I20260812 08:01:56.843796  9118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:56.844563  9118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:56.845700  9118 hybrid_clock.cc:648] HybridClock initialized: now 1786521716845654 us; error 57 us; skew 500 ppm
I20260812 08:01:56.847241  9118 webserver.cc:533] Webserver started at http://127.8.228.62:33943/ using document root <none> and password file <none>
I20260812 08:01:56.847726  9118 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:56.847779  9118 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:56.847950  9118 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:56.849287  9118 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data/instance:
uuid: "57b0244c00684f7d979c69a96e52e68c"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-6zbq"
I20260812 08:01:56.849699  9118 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal/instance:
uuid: "57b0244c00684f7d979c69a96e52e68c"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-6zbq"
I20260812 08:01:56.852576  9118 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260812 08:01:56.854393  9142 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.855217  9118 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 08:01:56.855317  9118 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "57b0244c00684f7d979c69a96e52e68c"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-6zbq"
I20260812 08:01:56.855392  9118 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:56.880462  9118 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:56.880964  9118 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:56.881166  9118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:56.888243  9232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:43545 every 8 connection(s)
I20260812 08:01:56.888253  9118 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:43545
I20260812 08:01:56.889123  9118 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:56.891683  9234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:56.893568  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 9118
I20260812 08:01:56.893714  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/master-0/wal/instance
I20260812 08:01:56.897262  9234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c: Bootstrap starting.
I20260812 08:01:56.899480  9234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:56.900144  9234 log.cc:826] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:56.901721  9234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c: No bootstrap required, opened a new log
I20260812 08:01:56.904496  9234 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b0244c00684f7d979c69a96e52e68c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43545 } }
I20260812 08:01:56.904675  9234 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:56.904713  9234 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b0244c00684f7d979c69a96e52e68c, State: Initialized, Role: FOLLOWER
I20260812 08:01:56.905089  9234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b0244c00684f7d979c69a96e52e68c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43545 } }
I20260812 08:01:56.905230  9234 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:56.905339  9234 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:56.905455  9234 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:56.906198  9234 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b0244c00684f7d979c69a96e52e68c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43545 } }
I20260812 08:01:56.906527  9234 leader_election.cc:304] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57b0244c00684f7d979c69a96e52e68c; no voters: 
I20260812 08:01:56.906827  9234 leader_election.cc:290] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:56.906912  9240 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:56.907095  9240 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [term 1 LEADER]: Becoming Leader. State: Replica: 57b0244c00684f7d979c69a96e52e68c, State: Running, Role: LEADER
I20260812 08:01:56.907398  9240 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b0244c00684f7d979c69a96e52e68c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43545 } }
I20260812 08:01:56.907881  9234 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:56.908401  9240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57b0244c00684f7d979c69a96e52e68c. Latest consensus state: current_term: 1 leader_uuid: "57b0244c00684f7d979c69a96e52e68c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b0244c00684f7d979c69a96e52e68c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43545 } } }
I20260812 08:01:56.908521  9240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:56.909000  9244 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:56.909518  9241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57b0244c00684f7d979c69a96e52e68c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b0244c00684f7d979c69a96e52e68c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43545 } } }
I20260812 08:01:56.909657  9241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:56.911849  9244 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:56.916498  9244 catalog_manager.cc:1383] Generated new cluster ID: 46609757ad2f4745840c1b0d1352565f
I20260812 08:01:56.916548  9244 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:56.923828  9244 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:56.924459  9244 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:56.930598  9244 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 57b0244c00684f7d979c69a96e52e68c: Generated new TSK 0
I20260812 08:01:56.930995  9244 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:56.940652  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:0
--local_ip_for_outbound_sockets=127.8.228.1
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43545
--builtin_ntp_servers=127.8.228.20:39889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:57.041554  9277 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:57.041723  9277 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:57.041741  9277 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:57.041782  9277 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:57.044953  9277 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:57.045042  9277 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:01:57.048597  9277 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:39889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43545
--never_fsync=true
--heap_profile_path=/tmp/kudu.9277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:57.049427  9277 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:57.050397  9277 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:57.055927  9285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:57.055938  9282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:57.056073  9277 server_base.cc:1061] running on GCE node
W20260812 08:01:57.056166  9283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:57.056525  9277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:57.056972  9277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:57.058145  9277 hybrid_clock.cc:648] HybridClock initialized: now 1786521717058132 us; error 31 us; skew 500 ppm
I20260812 08:01:57.059773  9277 webserver.cc:533] Webserver started at http://127.8.228.1:35995/ using document root <none> and password file <none>
I20260812 08:01:57.060271  9277 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:57.060322  9277 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:57.060491  9277 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:57.061821  9277 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data/instance:
uuid: "f6433e10a8e849c1a85b979e31f7e89a"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.062264  9277 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance:
uuid: "f6433e10a8e849c1a85b979e31f7e89a"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.065106  9277 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:57.067008  9295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.067885  9277 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:01:57.067968  9277 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "f6433e10a8e849c1a85b979e31f7e89a"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.068049  9277 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:57.086428  9277 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:57.086907  9277 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:57.087054  9277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:57.087527  9277 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:57.088424  9277 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:57.088469  9277 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.088507  9277 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:57.088536  9277 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.097662  9277 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:44985
I20260812 08:01:57.097692  9489 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:44985 every 8 connection(s)
I20260812 08:01:57.098482  9277 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:57.105273  9490 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43545
I20260812 08:01:57.105468  9490 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:57.105868  9490 heartbeater.cc:507] Master 127.8.228.62:43545 requested a full tablet report, sending...
I20260812 08:01:57.106556  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 9277
I20260812 08:01:57.106639  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:57.107189  9176 ts_manager.cc:194] Registered new tserver with Master: f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985)
I20260812 08:01:57.108345  9176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:36743
I20260812 08:01:57.108726  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:0
--local_ip_for_outbound_sockets=127.8.228.2
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43545
--builtin_ntp_servers=127.8.228.20:39889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:01:57.207037  9494 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:57.207223  9494 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:57.207252  9494 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:57.207304  9494 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:57.210464  9494 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:57.210566  9494 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:01:57.214135  9494 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:39889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43545
--never_fsync=true
--heap_profile_path=/tmp/kudu.9494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:57.214968  9494 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:57.215888  9494 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:57.221285  9507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:57.221323  9503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:57.221328  9504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:57.221550  9494 server_base.cc:1061] running on GCE node
I20260812 08:01:57.221853  9494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:57.222304  9494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:57.223474  9494 hybrid_clock.cc:648] HybridClock initialized: now 1786521717223456 us; error 28 us; skew 500 ppm
I20260812 08:01:57.224965  9494 webserver.cc:533] Webserver started at http://127.8.228.2:37289/ using document root <none> and password file <none>
I20260812 08:01:57.225435  9494 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:57.225490  9494 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:57.225651  9494 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:57.226986  9494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data/instance:
uuid: "1a61319626d64b4881976b838d79550b"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.227387  9494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance:
uuid: "1a61319626d64b4881976b838d79550b"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.230182  9494 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:57.232010  9521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.232851  9494 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:57.232944  9494 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "1a61319626d64b4881976b838d79550b"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.233014  9494 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:57.244580  9494 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:57.245054  9494 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:57.245195  9494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:57.245641  9494 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:57.246491  9494 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:57.246538  9494 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.246584  9494 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:57.246613  9494 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.256628  9494 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:40977
I20260812 08:01:57.256656  9713 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:40977 every 8 connection(s)
I20260812 08:01:57.257620  9494 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:57.258008  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 9494
I20260812 08:01:57.258117  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:57.260639  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.3:0
--local_ip_for_outbound_sockets=127.8.228.3
--webserver_interface=127.8.228.3
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43545
--builtin_ntp_servers=127.8.228.20:39889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:01:57.266866  9714 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43545
I20260812 08:01:57.267091  9714 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:57.267583  9714 heartbeater.cc:507] Master 127.8.228.62:43545 requested a full tablet report, sending...
I20260812 08:01:57.268605  9176 ts_manager.cc:194] Registered new tserver with Master: 1a61319626d64b4881976b838d79550b (127.8.228.2:40977)
I20260812 08:01:57.269353  9176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:34827
W20260812 08:01:57.363183  9718 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:01:57.363370  9718 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:57.363391  9718 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:57.363427  9718 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:57.366560  9718 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:57.366647  9718 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.3
I20260812 08:01:57.370182  9718 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:39889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.228.3
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43545
--never_fsync=true
--heap_profile_path=/tmp/kudu.9718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:57.371102  9718 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:57.372109  9718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:57.377869  9730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:57.377979  9733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:57.377969  9718 server_base.cc:1061] running on GCE node
W20260812 08:01:57.377938  9729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:57.378391  9718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:57.378880  9718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:57.380019  9718 hybrid_clock.cc:648] HybridClock initialized: now 1786521717380010 us; error 27 us; skew 500 ppm
I20260812 08:01:57.381547  9718 webserver.cc:533] Webserver started at http://127.8.228.3:44853/ using document root <none> and password file <none>
I20260812 08:01:57.382054  9718 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:57.382112  9718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:57.382277  9718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:57.383692  9718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data/instance:
uuid: "2354bc26021f4f8c90fc9454e86797d2"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.384131  9718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance:
uuid: "2354bc26021f4f8c90fc9454e86797d2"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.387068  9718 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:57.388895  9742 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.389761  9718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:57.389861  9718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal
uuid: "2354bc26021f4f8c90fc9454e86797d2"
format_stamp: "Formatted at 2026-08-12 08:01:57 on dist-test-slave-6zbq"
I20260812 08:01:57.389938  9718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:57.400532  9718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:57.401031  9718 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:57.401185  9718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:57.401649  9718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:57.402572  9718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:57.402622  9718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.402670  9718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:57.402699  9718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:57.411574  9718 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.3:43529
I20260812 08:01:57.411612  9926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.3:43529 every 8 connection(s)
I20260812 08:01:57.412489  9718 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:57.416929  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 9718
I20260812 08:01:57.417007  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:57.419685  9928 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43545
I20260812 08:01:57.419871  9928 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:57.420279  9928 heartbeater.cc:507] Master 127.8.228.62:43545 requested a full tablet report, sending...
I20260812 08:01:57.421152  9176 ts_manager.cc:194] Registered new tserver with Master: 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3:43529)
I20260812 08:01:57.421679  9176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.3:34739
I20260812 08:01:57.431026  9104 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:57.449334  9176 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42760:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:57.450229  9176 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:57.465647  9390 tablet_service.cc:1511] Processing CreateTablet for tablet ad40deae8a2a4ac290db488923fa7f80 (DEFAULT_TABLE table=test-workload [id=cd29830a39944be4976d6526ffa8500b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:57.465927  9607 tablet_service.cc:1511] Processing CreateTablet for tablet ad40deae8a2a4ac290db488923fa7f80 (DEFAULT_TABLE table=test-workload [id=cd29830a39944be4976d6526ffa8500b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:57.465927  9826 tablet_service.cc:1511] Processing CreateTablet for tablet ad40deae8a2a4ac290db488923fa7f80 (DEFAULT_TABLE table=test-workload [id=cd29830a39944be4976d6526ffa8500b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:57.466472  9390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad40deae8a2a4ac290db488923fa7f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:57.466811  9607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad40deae8a2a4ac290db488923fa7f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:57.466811  9826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad40deae8a2a4ac290db488923fa7f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:57.471135  9961 tablet_bootstrap.cc:492] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Bootstrap starting.
I20260812 08:01:57.472255  9962 tablet_bootstrap.cc:492] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2: Bootstrap starting.
I20260812 08:01:57.473153  9963 tablet_bootstrap.cc:492] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Bootstrap starting.
I20260812 08:01:57.474143  9961 tablet_bootstrap.cc:654] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:57.474146  9962 tablet_bootstrap.cc:654] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:57.474895  9963 tablet_bootstrap.cc:654] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:57.474968  9962 log.cc:826] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:57.474968  9961 log.cc:826] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:57.475620  9963 log.cc:826] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:57.476537  9962 tablet_bootstrap.cc:492] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2: No bootstrap required, opened a new log
I20260812 08:01:57.476537  9961 tablet_bootstrap.cc:492] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: No bootstrap required, opened a new log
I20260812 08:01:57.476712  9962 ts_tablet_manager.cc:1403] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20260812 08:01:57.476712  9961 ts_tablet_manager.cc:1403] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:57.476964  9963 tablet_bootstrap.cc:492] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: No bootstrap required, opened a new log
I20260812 08:01:57.477131  9963 ts_tablet_manager.cc:1403] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:01:57.479529  9963 raft_consensus.cc:359] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.479564  9961 raft_consensus.cc:359] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.479700  9963 raft_consensus.cc:740] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a61319626d64b4881976b838d79550b, State: Initialized, Role: FOLLOWER
I20260812 08:01:57.479802  9961 raft_consensus.cc:740] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6433e10a8e849c1a85b979e31f7e89a, State: Initialized, Role: FOLLOWER
I20260812 08:01:57.479900  9962 raft_consensus.cc:359] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.479979  9963 consensus_queue.cc:260] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.480075  9962 raft_consensus.cc:740] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2354bc26021f4f8c90fc9454e86797d2, State: Initialized, Role: FOLLOWER
I20260812 08:01:57.480086  9961 consensus_queue.cc:260] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.480324  9962 consensus_queue.cc:260] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.480769  9963 ts_tablet_manager.cc:1434] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:57.480778  9490 heartbeater.cc:499] Master 127.8.228.62:43545 was elected leader, sending a full tablet report...
I20260812 08:01:57.480899  9961 ts_tablet_manager.cc:1434] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:57.481065  9714 heartbeater.cc:499] Master 127.8.228.62:43545 was elected leader, sending a full tablet report...
I20260812 08:01:57.481434  9928 heartbeater.cc:499] Master 127.8.228.62:43545 was elected leader, sending a full tablet report...
I20260812 08:01:57.481575  9962 ts_tablet_manager.cc:1434] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:01:57.500713  9104 tablet_copy-itest.cc:200] loading data...
I20260812 08:01:57.501250  9647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad40deae8a2a4ac290db488923fa7f80"
dest_uuid: "1a61319626d64b4881976b838d79550b"
 from {username='slave'} at 127.0.0.1:50934
I20260812 08:01:57.501397  9647 raft_consensus.cc:493] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:57.501483  9647 raft_consensus.cc:3060] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:57.502256  9647 raft_consensus.cc:515] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.503144  9647 leader_election.cc:290] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [CANDIDATE]: Term 1 election: Requested vote from peers 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3:43529), f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985)
I20260812 08:01:57.507491  9860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad40deae8a2a4ac290db488923fa7f80" candidate_uuid: "1a61319626d64b4881976b838d79550b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2354bc26021f4f8c90fc9454e86797d2"
I20260812 08:01:57.507665  9860 raft_consensus.cc:3060] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:57.507712  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad40deae8a2a4ac290db488923fa7f80" candidate_uuid: "1a61319626d64b4881976b838d79550b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f6433e10a8e849c1a85b979e31f7e89a"
I20260812 08:01:57.507884  9418 raft_consensus.cc:3060] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:57.508698  9860 raft_consensus.cc:2468] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a61319626d64b4881976b838d79550b in term 1.
I20260812 08:01:57.508857  9418 raft_consensus.cc:2468] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a61319626d64b4881976b838d79550b in term 1.
W20260812 08:01:57.509020  9715 tablet.cc:2406] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:57.509297  9524 leader_election.cc:304] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a61319626d64b4881976b838d79550b, f6433e10a8e849c1a85b979e31f7e89a; no voters: 
I20260812 08:01:57.510105  9968 raft_consensus.cc:2804] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:57.510296  9968 raft_consensus.cc:697] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [term 1 LEADER]: Becoming Leader. State: Replica: 1a61319626d64b4881976b838d79550b, State: Running, Role: LEADER
I20260812 08:01:57.510681  9968 consensus_queue.cc:237] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.514729  9166 catalog_manager.cc:5719] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a61319626d64b4881976b838d79550b (127.8.228.2). New cstate: current_term: 1 leader_uuid: "1a61319626d64b4881976b838d79550b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } health_report { overall_health: UNKNOWN } } }
I20260812 08:01:57.545015  9418 raft_consensus.cc:1275] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 1 FOLLOWER]: Refusing update from remote peer 1a61319626d64b4881976b838d79550b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:57.545015  9860 raft_consensus.cc:1275] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 1 FOLLOWER]: Refusing update from remote peer 1a61319626d64b4881976b838d79550b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:57.545662  9985 consensus_queue.cc:1048] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:57.545823  9968 consensus_queue.cc:1048] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:57.552847  9994 mvcc.cc:204] Tried to move back new op lower bound from 7317592955065286656 to 7317592954927190016. Current Snapshot: MvccSnapshot[applied={T|T < 7317592955058262016}]
I20260812 08:01:57.555182  9995 mvcc.cc:204] Tried to move back new op lower bound from 7317592955065286656 to 7317592954927190016. Current Snapshot: MvccSnapshot[applied={T|T < 7317592955058262016}]
I20260812 08:01:57.557694  9997 mvcc.cc:204] Tried to move back new op lower bound from 7317592955065286656 to 7317592954927190016. Current Snapshot: MvccSnapshot[applied={T|T < 7317592955058262016}]
W20260812 08:01:57.580528 10021 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 08:01:57.592123  9860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad40deae8a2a4ac290db488923fa7f80"
dest_uuid: "2354bc26021f4f8c90fc9454e86797d2"
 from {username='slave'} at 127.0.0.1:58324
I20260812 08:01:57.592278  9860 raft_consensus.cc:493] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:01:57.592341  9860 raft_consensus.cc:3060] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:57.593112  9860 raft_consensus.cc:515] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.593928  9860 leader_election.cc:290] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [CANDIDATE]: Term 2 election: Requested vote from peers 1a61319626d64b4881976b838d79550b (127.8.228.2:40977), f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985)
I20260812 08:01:57.597532  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad40deae8a2a4ac290db488923fa7f80" candidate_uuid: "2354bc26021f4f8c90fc9454e86797d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: true dest_uuid: "f6433e10a8e849c1a85b979e31f7e89a"
I20260812 08:01:57.597631  9418 raft_consensus.cc:3060] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:57.598311  9418 raft_consensus.cc:2468] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2354bc26021f4f8c90fc9454e86797d2 in term 2.
I20260812 08:01:57.598652  9745 leader_election.cc:304] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2354bc26021f4f8c90fc9454e86797d2, f6433e10a8e849c1a85b979e31f7e89a; no voters: 
I20260812 08:01:57.598863  9973 raft_consensus.cc:2804] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:01:57.599042  9973 raft_consensus.cc:697] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2354bc26021f4f8c90fc9454e86797d2, State: Running, Role: LEADER
I20260812 08:01:57.599319  9973 consensus_queue.cc:237] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } }
I20260812 08:01:57.600800  9104 tablet_copy-itest.cc:232] successfully elected new leader
I20260812 08:01:57.601516  9165 catalog_manager.cc:5719] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 reported cstate change: term changed from 1 to 2, leader changed from 1a61319626d64b4881976b838d79550b (127.8.228.2) to 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3). New cstate: current_term: 2 leader_uuid: "2354bc26021f4f8c90fc9454e86797d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2354bc26021f4f8c90fc9454e86797d2" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a61319626d64b4881976b838d79550b" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 } health_report { overall_health: UNKNOWN } } }
I20260812 08:01:57.601975  9104 cluster_itest_util.cc:258] Not converged past 10 yet: 2.10 1.9
I20260812 08:01:57.703881  9104 cluster_itest_util.cc:258] Not converged past 10 yet: 2.10 1.9
I20260812 08:01:57.905719  9104 cluster_itest_util.cc:258] Not converged past 10 yet: 2.10 1.9
I20260812 08:01:58.042910  9418 raft_consensus.cc:1275] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 2 FOLLOWER]: Refusing update from remote peer 2354bc26021f4f8c90fc9454e86797d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20260812 08:01:58.043398  9973 consensus_queue.cc:1048] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6433e10a8e849c1a85b979e31f7e89a" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 44985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 08:01:58.207476  9104 tablet_copy-itest.cc:244] restarting workload...
W20260812 08:01:59.555445  9745 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.8.228.2:40977 for RPC RequestConsensusVote timed out after 1.960s (ON_OUTBOUND_QUEUE)
W20260812 08:02:00.633279  9930 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:57.594113 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.228.2:40977 (local address 127.8.228.3:58315)
0812 08:01:57.594243 (+   130us) negotiation.cc:107] Waiting for socket to connect
0812 08:01:57.594285 (+    42us) client_negotiation.cc:175] Beginning negotiation
0812 08:01:57.594378 (+    93us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:02:00.632778 (+3038400us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.8.228.2:40977: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 08:02:00.633502  9745 leader_election.cc:336] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1a61319626d64b4881976b838d79550b (127.8.228.2:40977): Timed out: Client connection negotiation failed: client connection to 127.8.228.2:40977: received 0 of 4 requested bytes
W20260812 08:02:03.214450  9945 meta_cache.cc:302] tablet ad40deae8a2a4ac290db488923fa7f80: replica 1a61319626d64b4881976b838d79550b (127.8.228.2:40977) has failed: Timed out: Write RPC to 127.8.228.2:40977 timed out after 5.000s (SENT)
W20260812 08:02:03.214596  9945 batcher.cc:441] Timed out: Failed to write batch of 50 ops to tablet ad40deae8a2a4ac290db488923fa7f80 after 1 attempt(s): Failed to write to server: 1a61319626d64b4881976b838d79550b (127.8.228.2:40977): Write RPC to 127.8.228.2:40977 timed out after 5.000s (SENT)
W20260812 08:02:03.750576  9930 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:00.634371 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.228.2:40977 (local address 127.8.228.3:51457)
0812 08:02:00.634501 (+   130us) negotiation.cc:107] Waiting for socket to connect
0812 08:02:00.634516 (+    15us) client_negotiation.cc:175] Beginning negotiation
0812 08:02:00.634619 (+   103us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:02:03.750492 (+3115873us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.8.228.2:40977: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 08:02:03.751106  9745 consensus_peers.cc:597] T ad40deae8a2a4ac290db488923fa7f80 P 2354bc26021f4f8c90fc9454e86797d2 -> Peer 1a61319626d64b4881976b838d79550b (127.8.228.2:40977): Couldn't send request to peer 1a61319626d64b4881976b838d79550b. Status: Timed out: Client connection negotiation failed: client connection to 127.8.228.2:40977: received 0 of 4 requested bytes. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:04.237241  9104 tablet_copy-itest.cc:253] shutting down new leader2354bc26021f4f8c90fc9454e86797d2...
I20260812 08:02:04.237362  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 9718
I20260812 08:02:04.254177  9104 tablet_copy-itest.cc:256] tombstoning original follower...
I20260812 08:02:04.254809  9390 tablet_service.cc:1558] Processing DeleteTablet for tablet ad40deae8a2a4ac290db488923fa7f80 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:37530
I20260812 08:02:04.255234 10082 tablet_replica.cc:333] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: stopping tablet replica
I20260812 08:02:04.255494 10082 raft_consensus.cc:2243] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:04.256484 10082 raft_consensus.cc:2272] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:04.257896 10082 ts_tablet_manager.cc:1916] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:04.259764 10082 ts_tablet_manager.cc:1929] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.348
I20260812 08:02:04.259850 10082 log.cc:1199] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786521716701421-9104-0/minicluster-data/ts-0/wal/wals/ad40deae8a2a4ac290db488923fa7f80
I20260812 08:02:04.260562  9104 tablet_copy-itest.cc:261] unpausing old (rogue) leader 1a61319626d64b4881976b838d79550b...
W20260812 08:02:04.262773  9958 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:04.261296 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.8.228.3:58315 (local address 127.8.228.2:40977)
0812 08:02:04.261892 (+   596us) server_negotiation.cc:207] Beginning negotiation
0812 08:02:04.261896 (+     4us) server_negotiation.cc:400] Waiting for connection header
0812 08:02:04.261911 (+    15us) server_negotiation.cc:408] Connection header received
0812 08:02:04.261954 (+    43us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 08:02:04.261958 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 08:02:04.261999 (+    41us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 08:02:04.262102 (+   103us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.228.3:58315: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":509}
W20260812 08:02:04.263190  9958 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:04.261349 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.8.228.3:59569 (local address 127.8.228.2:40977)
0812 08:02:04.262941 (+  1592us) server_negotiation.cc:207] Beginning negotiation
0812 08:02:04.262944 (+     3us) server_negotiation.cc:400] Waiting for connection header
0812 08:02:04.262954 (+    10us) server_negotiation.cc:408] Connection header received
0812 08:02:04.262986 (+    32us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 08:02:04.262988 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 08:02:04.263020 (+    32us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 08:02:04.263102 (+    82us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.228.3:59569: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":1529,"thread_start_us":59,"threads_started":1}
W20260812 08:02:04.263558  9958 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:04.261461 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.8.228.3:51457 (local address 127.8.228.2:40977)
0812 08:02:04.263331 (+  1870us) server_negotiation.cc:207] Beginning negotiation
0812 08:02:04.263334 (+     3us) server_negotiation.cc:400] Waiting for connection header
0812 08:02:04.263344 (+    10us) server_negotiation.cc:408] Connection header received
0812 08:02:04.263373 (+    29us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 08:02:04.263375 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 08:02:04.263403 (+    28us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 08:02:04.263472 (+    69us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.228.3:51457: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":1813,"thread_start_us":82,"threads_started":1}
W20260812 08:02:04.266909  9524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.228.3:43529: connect: Connection refused (error 111)
W20260812 08:02:04.267990  9524 consensus_peers.cc:597] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Couldn't send request to peer f6433e10a8e849c1a85b979e31f7e89a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:04.268098  9524 consensus_peers.cc:597] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3:43529): Couldn't send request to peer 2354bc26021f4f8c90fc9454e86797d2. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.3:43529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:04.687115 10092 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:04.687898  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:05.265548 10094 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:05.265935  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:05.701013 10094 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:05.701448  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:06.303449 10103 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:06.303846  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:06.861310 10106 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:06.861732  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:06.866364  9524 consensus_peers.cc:597] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3:43529): Couldn't send request to peer 2354bc26021f4f8c90fc9454e86797d2. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.3:43529: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:02:07.272132 10106 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:07.272500  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:07.672093 10106 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:07.672488  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:08.066964 10106 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:08.067366  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:08.475802 10106 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:08.476214  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:09.007925 10116 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:09.008280  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
I20260812 08:02:09.265895  9104 tablet_copy-itest.cc:273] the rogue leader was not able to tablet copy the tombstoned follower
I20260812 08:02:09.266664 10116 ts_tablet_manager.cc:933] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Initiating tablet copy from peer 1a61319626d64b4881976b838d79550b (127.8.228.2:40977)
I20260812 08:02:09.267241 10116 tablet_copy_client.cc:323] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.2:40977
I20260812 08:02:09.270805  9678 tablet_copy_service.cc:140] P 1a61319626d64b4881976b838d79550b: Received BeginTabletCopySession request for tablet ad40deae8a2a4ac290db488923fa7f80 from peer f6433e10a8e849c1a85b979e31f7e89a ({username='slave'} at 127.8.228.1:47655)
I20260812 08:02:09.270920  9678 tablet_copy_service.cc:161] P 1a61319626d64b4881976b838d79550b: Beginning new tablet copy session on tablet ad40deae8a2a4ac290db488923fa7f80 from peer f6433e10a8e849c1a85b979e31f7e89a at {username='slave'} at 127.8.228.1:47655: session id = f6433e10a8e849c1a85b979e31f7e89a-ad40deae8a2a4ac290db488923fa7f80
I20260812 08:02:09.272023  9678 tablet_copy_source_session.cc:215] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b: Tablet Copy: opened 0 blocks and 1 log segments
W20260812 08:02:09.541568  9524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.228.3:43529: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260812 08:02:09.542325  9524 consensus_peers.cc:597] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3:43529): Couldn't send request to peer 2354bc26021f4f8c90fc9454e86797d2. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.3:43529: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:02:09.632387 10116 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:09.632782  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:10.065174 10116 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:10.065531  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:10.630198 10130 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:10.630612  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:11.251559 10140 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:11.251950  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:11.873081 10146 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:11.873490  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:12.323307 10146 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:12.323704  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:12.410897  9524 consensus_peers.cc:597] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer 2354bc26021f4f8c90fc9454e86797d2 (127.8.228.3:43529): Couldn't send request to peer 2354bc26021f4f8c90fc9454e86797d2. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.3:43529: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 08:02:12.788365 10146 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:12.788717  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:13.355598 10153 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:13.356036  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:13.867328 10154 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:13.867698  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 08:02:14.271196 10154 ts_tablet_manager.cc:732] T ad40deae8a2a4ac290db488923fa7f80 P f6433e10a8e849c1a85b979e31f7e89a: Tablet Copy: Invalid argument: Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 08:02:14.271529  9524 consensus_peers.cc:576] T ad40deae8a2a4ac290db488923fa7f80 P 1a61319626d64b4881976b838d79550b -> Peer f6433e10a8e849c1a85b979e31f7e89a (127.8.228.1:44985): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet ad40deae8a2a4ac290db488923fa7f80 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
I20260812 08:02:14.282053  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 9277
I20260812 08:02:14.295238  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 9494
I20260812 08:02:14.306643  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 9118
2026-08-12T08:02:14Z chronyd exiting
[       OK ] TabletCopyITest.TestRejectRogueLeader (17620 ms)
[ RUN      ] TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest
2026-08-12T08:02:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:14Z Disabled control of system clock
I20260812 08:02:14.340302  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:43693
--webserver_interface=127.8.228.62
--webserver_port=0
--builtin_ntp_servers=127.8.228.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:43693 with env {}
W20260812 08:02:14.437628 10165 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:14.437799 10165 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:14.437839 10165 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:14.441046 10165 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:14.441110 10165 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:14.441133 10165 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:14.441164 10165 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:14.444859 10165 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:43693
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:43693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:14.445700 10165 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:14.446679 10165 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:14.451557 10177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:14.451655 10173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:14.451648 10171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:14.451637 10165 server_base.cc:1061] running on GCE node
I20260812 08:02:14.452222 10165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:14.453001 10165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:14.454149 10165 hybrid_clock.cc:648] HybridClock initialized: now 1786521734454142 us; error 26 us; skew 500 ppm
I20260812 08:02:14.455753 10165 webserver.cc:533] Webserver started at http://127.8.228.62:41881/ using document root <none> and password file <none>
I20260812 08:02:14.456249 10165 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:14.456306 10165 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:14.456475 10165 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:14.457805 10165 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data/instance:
uuid: "4d5bdf4060ae4aa3868e02299045271c"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.458238 10165 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal/instance:
uuid: "4d5bdf4060ae4aa3868e02299045271c"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.461054 10165 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:14.462953 10189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.463783 10165 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:14.463896 10165 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "4d5bdf4060ae4aa3868e02299045271c"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.463968 10165 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:14.479861 10165 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:14.480355 10165 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:14.480502 10165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:14.487236 10165 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:43693
I20260812 08:02:14.487233 10278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:43693 every 8 connection(s)
I20260812 08:02:14.488131 10165 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:14.490676 10279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:14.494685  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 10165
I20260812 08:02:14.494800  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/wal/instance
I20260812 08:02:14.495208 10279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c: Bootstrap starting.
I20260812 08:02:14.497584 10279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:14.498425 10279 log.cc:826] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:14.500008 10279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c: No bootstrap required, opened a new log
I20260812 08:02:14.502244 10279 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5bdf4060ae4aa3868e02299045271c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43693 } }
I20260812 08:02:14.502437 10279 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:14.502496 10279 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5bdf4060ae4aa3868e02299045271c, State: Initialized, Role: FOLLOWER
I20260812 08:02:14.502851 10279 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5bdf4060ae4aa3868e02299045271c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43693 } }
I20260812 08:02:14.502955 10279 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:14.503013 10279 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:14.503106 10279 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:14.503894 10279 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5bdf4060ae4aa3868e02299045271c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43693 } }
I20260812 08:02:14.504222 10279 leader_election.cc:304] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d5bdf4060ae4aa3868e02299045271c; no voters: 
I20260812 08:02:14.504501 10279 leader_election.cc:290] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:14.504611 10287 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:14.504794 10287 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [term 1 LEADER]: Becoming Leader. State: Replica: 4d5bdf4060ae4aa3868e02299045271c, State: Running, Role: LEADER
I20260812 08:02:14.505100 10287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5bdf4060ae4aa3868e02299045271c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43693 } }
I20260812 08:02:14.506186 10279 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:14.506510 10291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d5bdf4060ae4aa3868e02299045271c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5bdf4060ae4aa3868e02299045271c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43693 } } }
I20260812 08:02:14.506610 10291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:14.506564 10290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d5bdf4060ae4aa3868e02299045271c. Latest consensus state: current_term: 1 leader_uuid: "4d5bdf4060ae4aa3868e02299045271c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d5bdf4060ae4aa3868e02299045271c" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 43693 } } }
I20260812 08:02:14.506655 10290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:14.506939 10294 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:14.509450 10294 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:14.513998 10294 catalog_manager.cc:1383] Generated new cluster ID: ab0b14a72db54c9d9f6977a8b67dfd23
I20260812 08:02:14.514057 10294 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:14.533618 10294 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:14.534660 10294 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:14.544961 10294 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 4d5bdf4060ae4aa3868e02299045271c: Generated new TSK 0
I20260812 08:02:14.545383 10294 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:14.551043  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:0
--local_ip_for_outbound_sockets=127.8.228.1
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--builtin_ntp_servers=127.8.228.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260812 08:02:14.657310 10324 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:14.657541 10324 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:14.657600 10324 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:14.662052 10324 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:14.662231 10324 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:02:14.666837 10324 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--never_fsync=true
--heap_profile_path=/tmp/kudu.10324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:14.668110 10324 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:14.669502 10324 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:14.678042 10337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:14.678102 10333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:14.678426 10340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:14.678699 10324 server_base.cc:1061] running on GCE node
I20260812 08:02:14.679097 10324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:14.679713 10324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:14.680879 10324 hybrid_clock.cc:648] HybridClock initialized: now 1786521734680863 us; error 31 us; skew 500 ppm
I20260812 08:02:14.682960 10324 webserver.cc:533] Webserver started at http://127.8.228.1:38443/ using document root <none> and password file <none>
I20260812 08:02:14.683647 10324 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:14.683727 10324 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:14.683945 10324 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:14.685932 10324 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data/instance:
uuid: "0b41f1db988e40f6ad6d850527f34c49"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.686570 10324 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance:
uuid: "0b41f1db988e40f6ad6d850527f34c49"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.690963 10324 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:02:14.693557 10349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.694715 10324 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:14.694825 10324 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "0b41f1db988e40f6ad6d850527f34c49"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.694921 10324 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:14.707151 10324 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:14.707763 10324 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:14.707911 10324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:14.708403 10324 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:14.709272 10324 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:14.709317 10324 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.709357 10324 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:14.709385 10324 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.717731 10324 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:38325
I20260812 08:02:14.717770 10539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:38325 every 8 connection(s)
I20260812 08:02:14.718631 10324 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:14.726497 10543 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43693
I20260812 08:02:14.726707 10543 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:14.727128  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 10324
I20260812 08:02:14.727136 10543 heartbeater.cc:507] Master 127.8.228.62:43693 requested a full tablet report, sending...
I20260812 08:02:14.727216  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:14.728526 10218 ts_manager.cc:194] Registered new tserver with Master: 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325)
I20260812 08:02:14.729456  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:0
--local_ip_for_outbound_sockets=127.8.228.2
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--builtin_ntp_servers=127.8.228.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 08:02:14.729915 10218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:47661
W20260812 08:02:14.826884 10550 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:14.827052 10550 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:14.827117 10550 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:14.830225 10550 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:14.830330 10550 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:02:14.834023 10550 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--never_fsync=true
--heap_profile_path=/tmp/kudu.10550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:14.834918 10550 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:14.835850 10550 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:14.841280 10558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:14.841267 10557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:14.841315 10564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:14.841421 10550 server_base.cc:1061] running on GCE node
I20260812 08:02:14.841857 10550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:14.842324 10550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:14.843518 10550 hybrid_clock.cc:648] HybridClock initialized: now 1786521734843503 us; error 30 us; skew 500 ppm
I20260812 08:02:14.845057 10550 webserver.cc:533] Webserver started at http://127.8.228.2:38095/ using document root <none> and password file <none>
I20260812 08:02:14.845538 10550 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:14.845595 10550 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:14.845763 10550 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:14.847146 10550 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data/instance:
uuid: "aee34e3c427f4a0e84020a51068e05c2"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.847572 10550 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance:
uuid: "aee34e3c427f4a0e84020a51068e05c2"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.850543 10550 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:14.852385 10573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.853269 10550 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:14.853367 10550 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "aee34e3c427f4a0e84020a51068e05c2"
format_stamp: "Formatted at 2026-08-12 08:02:14 on dist-test-slave-6zbq"
I20260812 08:02:14.853442 10550 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:14.883654 10550 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:14.884199 10550 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:14.884351 10550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:14.884851 10550 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:14.885739 10550 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:14.885787 10550 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.885836 10550 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:14.885864 10550 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:14.894403 10550 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:40375
I20260812 08:02:14.894414 10758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:40375 every 8 connection(s)
I20260812 08:02:14.895228 10550 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:14.902809 10759 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43693
I20260812 08:02:14.902988 10759 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:14.903380 10759 heartbeater.cc:507] Master 127.8.228.62:43693 requested a full tablet report, sending...
I20260812 08:02:14.904322 10218 ts_manager.cc:194] Registered new tserver with Master: aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375)
I20260812 08:02:14.904842 10218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:48549
I20260812 08:02:14.905310  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 10550
I20260812 08:02:14.905409  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:14.907311  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.3:0
--local_ip_for_outbound_sockets=127.8.228.3
--webserver_interface=127.8.228.3
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--builtin_ntp_servers=127.8.228.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260812 08:02:15.004264 10764 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:15.004432 10764 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:15.004472 10764 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:15.007647 10764 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:15.007741 10764 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.3
I20260812 08:02:15.011330 10764 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.228.3
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--never_fsync=true
--heap_profile_path=/tmp/kudu.10764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:15.012135 10764 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:15.013046 10764 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:15.018462 10772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:15.018473 10773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:15.018460 10775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:15.018671 10764 server_base.cc:1061] running on GCE node
I20260812 08:02:15.019004 10764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:15.019465 10764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:15.020610 10764 hybrid_clock.cc:648] HybridClock initialized: now 1786521735020597 us; error 28 us; skew 500 ppm
I20260812 08:02:15.022118 10764 webserver.cc:533] Webserver started at http://127.8.228.3:34769/ using document root <none> and password file <none>
I20260812 08:02:15.022634 10764 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:15.022689 10764 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:15.022867 10764 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:15.024194 10764 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data/instance:
uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.024610 10764 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance:
uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.027496 10764 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:15.029302 10789 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.030134 10764 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:15.030230 10764 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal
uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.030314 10764 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:15.050096 10764 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:15.050637 10764 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:15.050781 10764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:15.051242 10764 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:15.052068 10764 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:15.052115 10764 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.052171 10764 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:15.052196 10764 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.060436 10764 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.3:39447
I20260812 08:02:15.060487 10979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.3:39447 every 8 connection(s)
I20260812 08:02:15.061259 10764 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:15.062706  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 10764
I20260812 08:02:15.062803  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:15.065037  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.4:0
--local_ip_for_outbound_sockets=127.8.228.4
--webserver_interface=127.8.228.4
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--builtin_ntp_servers=127.8.228.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 08:02:15.069839 10980 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43693
I20260812 08:02:15.070075 10980 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:15.070650 10980 heartbeater.cc:507] Master 127.8.228.62:43693 requested a full tablet report, sending...
I20260812 08:02:15.071751 10218 ts_manager.cc:194] Registered new tserver with Master: f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:15.072288 10218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.3:53359
W20260812 08:02:15.163618 10984 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:15.163779 10984 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:15.163821 10984 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:15.166934 10984 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:15.167030 10984 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.4
I20260812 08:02:15.170614 10984 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.8.228.4
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--never_fsync=true
--heap_profile_path=/tmp/kudu.10984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:15.171397 10984 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:15.172312 10984 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:15.177706 10995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:15.177695 10993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:15.177686 10992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:15.177966 10984 server_base.cc:1061] running on GCE node
I20260812 08:02:15.178414 10984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:15.178877 10984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:15.180020 10984 hybrid_clock.cc:648] HybridClock initialized: now 1786521735180007 us; error 31 us; skew 500 ppm
I20260812 08:02:15.181499 10984 webserver.cc:533] Webserver started at http://127.8.228.4:40905/ using document root <none> and password file <none>
I20260812 08:02:15.181965 10984 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:15.182021 10984 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:15.182181 10984 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:15.183514 10984 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data/instance:
uuid: "62bf9cb31e88405295026392bbe46fc0"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.183931 10984 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal/instance:
uuid: "62bf9cb31e88405295026392bbe46fc0"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.186780 10984 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:15.188688 11005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.189533 10984 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:15.189628 10984 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal
uuid: "62bf9cb31e88405295026392bbe46fc0"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.189702 10984 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:15.243151 10984 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:15.243681 10984 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:15.243826 10984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:15.244311 10984 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:15.245206 10984 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:15.245256 10984 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.245306 10984 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:15.245332 10984 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.254156 10984 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.4:38119
I20260812 08:02:15.254211 11195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.4:38119 every 8 connection(s)
I20260812 08:02:15.255000 10984 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
I20260812 08:02:15.261363  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 10984
I20260812 08:02:15.261468  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal/instance
I20260812 08:02:15.262574 11196 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43693
I20260812 08:02:15.262771 11196 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:15.263273 11196 heartbeater.cc:507] Master 127.8.228.62:43693 requested a full tablet report, sending...
I20260812 08:02:15.263630  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.5:0
--local_ip_for_outbound_sockets=127.8.228.5
--webserver_interface=127.8.228.5
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--builtin_ntp_servers=127.8.228.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 08:02:15.264202 10218 ts_manager.cc:194] Registered new tserver with Master: 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119)
I20260812 08:02:15.264816 10218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.4:43443
W20260812 08:02:15.361622 11199 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:15.361796 11199 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:15.361838 11199 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:15.364965 11199 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:15.365058 11199 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.5
I20260812 08:02:15.368681 11199 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.5:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data/info.pb
--webserver_interface=127.8.228.5
--webserver_port=0
--tserver_master_addrs=127.8.228.62:43693
--never_fsync=true
--heap_profile_path=/tmp/kudu.11199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.5

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:15.369518 11199 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:15.370491 11199 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:15.375845 11211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:15.375859 11215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:15.375862 11222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:15.376094 11199 server_base.cc:1061] running on GCE node
I20260812 08:02:15.376475 11199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:15.377028 11199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:15.378171 11199 hybrid_clock.cc:648] HybridClock initialized: now 1786521735378156 us; error 29 us; skew 500 ppm
I20260812 08:02:15.379690 11199 webserver.cc:533] Webserver started at http://127.8.228.5:43311/ using document root <none> and password file <none>
I20260812 08:02:15.380164 11199 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:15.380216 11199 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:15.380376 11199 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:15.381734 11199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data/instance:
uuid: "df58e7a1f88a4967a911c0fdb0bad058"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.382212 11199 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal/instance:
uuid: "df58e7a1f88a4967a911c0fdb0bad058"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.385119 11199 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:15.386956 11232 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.387796 11199 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:15.387883 11199 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal
uuid: "df58e7a1f88a4967a911c0fdb0bad058"
format_stamp: "Formatted at 2026-08-12 08:02:15 on dist-test-slave-6zbq"
I20260812 08:02:15.387965 11199 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:15.396817 11199 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:15.397284 11199 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:15.397423 11199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:15.397884 11199 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:15.398756 11199 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:15.398801 11199 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.398838 11199 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:15.398867 11199 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:15.407663 11199 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.5:42483
I20260812 08:02:15.407711 11433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.5:42483 every 8 connection(s)
I20260812 08:02:15.408483 11199 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data/info.pb
I20260812 08:02:15.409384  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 11199
I20260812 08:02:15.409469  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal/instance
I20260812 08:02:15.416083 11434 heartbeater.cc:344] Connected to a master server at 127.8.228.62:43693
I20260812 08:02:15.416285 11434 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:15.416688 11434 heartbeater.cc:507] Master 127.8.228.62:43693 requested a full tablet report, sending...
I20260812 08:02:15.417553 10218 ts_manager.cc:194] Registered new tserver with Master: df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483)
I20260812 08:02:15.418053 10218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.5:53081
I20260812 08:02:15.423444  9104 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 08:02:15.437935 10218 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54048:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:15.438927 10218 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260812 08:02:15.454753 11309 tablet_service.cc:1511] Processing CreateTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da (DEFAULT_TABLE table=test-workload [id=f9b4efa9a61b48c3a2b6a4274493d05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:15.454753 11085 tablet_service.cc:1511] Processing CreateTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da (DEFAULT_TABLE table=test-workload [id=f9b4efa9a61b48c3a2b6a4274493d05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:15.455718 11085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:15.455718 11309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:15.457695 10661 tablet_service.cc:1511] Processing CreateTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da (DEFAULT_TABLE table=test-workload [id=f9b4efa9a61b48c3a2b6a4274493d05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:15.458607 10661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:15.460476 10434 tablet_service.cc:1511] Processing CreateTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da (DEFAULT_TABLE table=test-workload [id=f9b4efa9a61b48c3a2b6a4274493d05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:15.461228 10434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:15.461212 11479 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Bootstrap starting.
I20260812 08:02:15.462105 11477 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Bootstrap starting.
I20260812 08:02:15.464047 11477 tablet_bootstrap.cc:654] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:15.464058 11479 tablet_bootstrap.cc:654] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:15.464845 11479 log.cc:826] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:15.464852 11477 log.cc:826] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:15.464754 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da (DEFAULT_TABLE table=test-workload [id=f9b4efa9a61b48c3a2b6a4274493d05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:15.465549 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:15.466506 11477 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: No bootstrap required, opened a new log
I20260812 08:02:15.466667 11477 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:15.467971 11485 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Bootstrap starting.
I20260812 08:02:15.469513 11477 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.469805 11477 raft_consensus.cc:385] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:15.469911 11477 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df58e7a1f88a4967a911c0fdb0bad058, State: Initialized, Role: FOLLOWER
I20260812 08:02:15.470037 11485 tablet_bootstrap.cc:654] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:15.470461 11477 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.470825 11485 log.cc:826] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:15.471369 11477 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:15.471549 11434 heartbeater.cc:499] Master 127.8.228.62:43693 was elected leader, sending a full tablet report...
I20260812 08:02:15.471787 11479 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: No bootstrap required, opened a new log
I20260812 08:02:15.471994 11479 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.000s
I20260812 08:02:15.472163 11489 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Bootstrap starting.
I20260812 08:02:15.472363 11485 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: No bootstrap required, opened a new log
I20260812 08:02:15.472360 11487 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap starting.
I20260812 08:02:15.472527 11485 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.002s
I20260812 08:02:15.474213 11487 tablet_bootstrap.cc:654] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:15.474947 11487 log.cc:826] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:15.475142 11479 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.475329 11479 raft_consensus.cc:385] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:15.475380 11479 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62bf9cb31e88405295026392bbe46fc0, State: Initialized, Role: FOLLOWER
I20260812 08:02:15.475286 11485 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.475479 11485 raft_consensus.cc:385] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:15.475528 11485 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee34e3c427f4a0e84020a51068e05c2, State: Initialized, Role: FOLLOWER
I20260812 08:02:15.475749 11479 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.476055 11485 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.476575 11479 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:15.476734 11196 heartbeater.cc:499] Master 127.8.228.62:43693 was elected leader, sending a full tablet report...
I20260812 08:02:15.476902 11485 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260812 08:02:15.476950 10759 heartbeater.cc:499] Master 127.8.228.62:43693 was elected leader, sending a full tablet report...
I20260812 08:02:15.477607 11487 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: No bootstrap required, opened a new log
I20260812 08:02:15.477775 11487 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
I20260812 08:02:15.478078 11489 tablet_bootstrap.cc:654] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:15.478895 11489 log.cc:826] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:15.480463 11489 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: No bootstrap required, opened a new log
I20260812 08:02:15.480636 11489 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Time spent bootstrapping tablet: real 0.009s	user 0.001s	sys 0.002s
I20260812 08:02:15.480513 11487 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.480708 11487 raft_consensus.cc:385] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:15.480767 11487 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b41f1db988e40f6ad6d850527f34c49, State: Initialized, Role: FOLLOWER
I20260812 08:02:15.481153 11487 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.481711 10543 heartbeater.cc:499] Master 127.8.228.62:43693 was elected leader, sending a full tablet report...
I20260812 08:02:15.481900 11487 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:15.483259 11489 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.483450 11489 raft_consensus.cc:385] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:15.483546 11489 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f984e61bbe3b49c5bbcfe042280b5f6f, State: Initialized, Role: FOLLOWER
I20260812 08:02:15.483928 11489 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.484510 10980 heartbeater.cc:499] Master 127.8.228.62:43693 was elected leader, sending a full tablet report...
I20260812 08:02:15.484531 11489 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
W20260812 08:02:15.505762 11197 tablet.cc:2406] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:15.562155 10982 tablet.cc:2406] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:15.646438 10760 tablet.cc:2406] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:15.659236 11435 tablet.cc:2406] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:15.670622 11499 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:15.670806 11499 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.672058 11499 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:15.677663 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:15.677940 11351 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 0.
I20260812 08:02:15.678001 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:15.678082 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:15.678090 10694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:15.678277 10898 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 0.
I20260812 08:02:15.678277 11119 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 0.
I20260812 08:02:15.678359 10694 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 0.
I20260812 08:02:15.678740 10352 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 0b41f1db988e40f6ad6d850527f34c49, 62bf9cb31e88405295026392bbe46fc0, df58e7a1f88a4967a911c0fdb0bad058; no voters: 
I20260812 08:02:15.678992 11499 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:15.679059 11499 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:15.679107 11499 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:15.679901 11499 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.680344 11499 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [CANDIDATE]: Term 1 election: Requested vote from peers 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:15.680598 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0"
I20260812 08:02:15.680603 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058"
I20260812 08:02:15.680706 11119 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:15.680704 11351 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:15.680749 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
I20260812 08:02:15.680766 10694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2"
I20260812 08:02:15.680841 10898 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:15.680867 10694 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:15.681772 11351 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 1.
I20260812 08:02:15.681818 10694 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 1.
I20260812 08:02:15.681838 11119 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 1.
I20260812 08:02:15.682122 10353 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 0b41f1db988e40f6ad6d850527f34c49, aee34e3c427f4a0e84020a51068e05c2, df58e7a1f88a4967a911c0fdb0bad058; no voters: 
I20260812 08:02:15.682305 11499 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:15.682400 10898 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 1.
I20260812 08:02:15.682525 11499 raft_consensus.cc:697] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 LEADER]: Becoming Leader. State: Replica: 0b41f1db988e40f6ad6d850527f34c49, State: Running, Role: LEADER
I20260812 08:02:15.682819 11499 consensus_queue.cc:237] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:15.685750 10218 catalog_manager.cc:5719] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1). New cstate: current_term: 1 leader_uuid: "0b41f1db988e40f6ad6d850527f34c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:15.719873 10544 tablet.cc:2406] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:15.753790  9104 tablet_copy-itest.cc:761] Iteration 1
I20260812 08:02:15.766961 11351 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Refusing update from remote peer 0b41f1db988e40f6ad6d850527f34c49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:15.766961 10898 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 1 FOLLOWER]: Refusing update from remote peer 0b41f1db988e40f6ad6d850527f34c49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:15.767016 11119 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 1 FOLLOWER]: Refusing update from remote peer 0b41f1db988e40f6ad6d850527f34c49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:15.767215 10694 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Refusing update from remote peer 0b41f1db988e40f6ad6d850527f34c49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:15.767596 11513 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:15.767752 11523 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:15.767912 11525 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:15.768046 11499 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:15.774955 11522 mvcc.cc:204] Tried to move back new op lower bound from 7317593029694873600 to 7317593029359779840. Current Snapshot: MvccSnapshot[applied={T|T < 7317593029694873600}]
I20260812 08:02:15.775992 11529 mvcc.cc:204] Tried to move back new op lower bound from 7317593029694873600 to 7317593029359779840. Current Snapshot: MvccSnapshot[applied={T|T < 7317593029694873600}]
I20260812 08:02:15.776855 11528 mvcc.cc:204] Tried to move back new op lower bound from 7317593029694873600 to 7317593029359779840. Current Snapshot: MvccSnapshot[applied={T|T < 7317593029694873600}]
I20260812 08:02:15.779264 11530 mvcc.cc:204] Tried to move back new op lower bound from 7317593029694873600 to 7317593029359779840. Current Snapshot: MvccSnapshot[applied={T|T < 7317593029694873600}]
I20260812 08:02:15.780601 11532 mvcc.cc:204] Tried to move back new op lower bound from 7317593029694873600 to 7317593029359779840. Current Snapshot: MvccSnapshot[applied={T|T < 7317593029694873600}]
I20260812 08:02:15.867213  9104 tablet_copy-itest.cc:780] Tombstoning follower tablet 0e853fa7ef1d4cc184f3732c2c0a29da on TS aee34e3c427f4a0e84020a51068e05c2
I20260812 08:02:15.867765 10661 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:35130
I20260812 08:02:15.871481 11550 tablet_replica.cc:333] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: stopping tablet replica
W20260812 08:02:15.871588 10692 raft_consensus.cc:1579] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 23' and following 0 ops. Status for this op: Illegal state: STOPPING
I20260812 08:02:15.871733 10692 raft_consensus.cc:1595] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Rejecting Update request from peer 0b41f1db988e40f6ad6d850527f34c49 for term 1. Could not prepare a single op due to: Illegal state: STOPPING
I20260812 08:02:15.871805 11550 raft_consensus.cc:2243] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:15.872009 11550 raft_consensus.cc:2272] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 08:02:15.872094 10353 consensus_peers.cc:597] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 -> Peer aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375): Couldn't send request to peer aee34e3c427f4a0e84020a51068e05c2. Status: Illegal state: Rejecting Update request from peer 0b41f1db988e40f6ad6d850527f34c49 for term 1. Could not prepare a single op due to: Illegal state: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:15.873874 11550 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:15.876916 11550 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.22
I20260812 08:02:15.877007 11550 log.cc:1199] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/wal/wals/0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:16.303586 11523 consensus_queue.cc:799] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [LEADER]: Peer aee34e3c427f4a0e84020a51068e05c2 is lagging by at least 45 ops behind the committed index 
I20260812 08:02:16.841603 11556 ts_tablet_manager.cc:933] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Initiating tablet copy from peer 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325)
I20260812 08:02:16.842610 11556 tablet_copy_client.cc:323] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.1:38325
I20260812 08:02:16.847532 10503 tablet_copy_service.cc:140] P 0b41f1db988e40f6ad6d850527f34c49: Received BeginTabletCopySession request for tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer aee34e3c427f4a0e84020a51068e05c2 ({username='slave'} at 127.8.228.2:32833)
I20260812 08:02:16.847678 10503 tablet_copy_service.cc:161] P 0b41f1db988e40f6ad6d850527f34c49: Beginning new tablet copy session on tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer aee34e3c427f4a0e84020a51068e05c2 at {username='slave'} at 127.8.228.2:32833: session id = aee34e3c427f4a0e84020a51068e05c2-0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:16.849052 10503 tablet_copy_source_session.cc:215] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:16.850492 11556 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:16.852466 11556 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.22
I20260812 08:02:16.852665 11556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:16.854413 11556 tablet_copy_client.cc:806] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:16.854580 11556 tablet_copy_client.cc:670] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:16.856587  9104 tablet_copy-itest.cc:790] Tombstoning leader tablet 0e853fa7ef1d4cc184f3732c2c0a29da on TS 0b41f1db988e40f6ad6d850527f34c49
I20260812 08:02:16.856880 11556 tablet_copy_client.cc:538] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:16.857084 10434 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:42206
I20260812 08:02:16.858821 11556 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Bootstrap starting.
I20260812 08:02:16.866505 11562 tablet_replica.cc:333] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: stopping tablet replica
I20260812 08:02:16.867079 11562 raft_consensus.cc:2243] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:16.868884 11562 pending_rounds.cc:70] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Trying to abort 1 pending ops.
I20260812 08:02:16.868980 11562 pending_rounds.cc:77] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Aborting op as it isn't in flight: id { term: 1 index: 265 } timestamp: 7317593034199625728 op_type: WRITE_OP write_request { tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\023<\252<\361\253\273\035\000\000\000\000\000\000\000\000\000@\000\000\000\000\000\000" indirect_data: "<redacted>""0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7317593034182606848 authz_token { token_data: "\010\263\323\360\323\006\"3\n\005slave\022*\n f9b4efa9a61b48c3a2b6a4274493d05d\020\001\030\001 \001(\001" signature: "<redacted>""\006k\257\323|\037\275\326aq=\305\253X\\\237\0149\350\nD\007\323\261\374F\230\217\034H\213\363s+]\324\002\023\214<w\303\215\205\271\\S\010\326m\232\353\265\311\337\373\317eD\227g\363_!" signing_key_seq_num: 0 } } request_id { client_id: "8955df605fd64c7e811238f9fe57c22f" seq_no: 263 first_incomplete_seq_no: 263 attempt_no: 0 }
W20260812 08:02:16.869254 11562 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36364: Aborted: Op aborted
I20260812 08:02:16.869580 11562 raft_consensus.cc:2272] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:16.871255 11562 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:16.873060 11562 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.265
I20260812 08:02:16.873181 11562 log.cc:1199] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal/wals/0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:17.011958 11556 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=261 overwritten=0 applied=260 ignored=0} inserts{seen=259 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:17.012307 11556 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Bootstrap complete.
I20260812 08:02:17.012502 11556 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Time spent bootstrapping tablet: real 0.154s	user 0.147s	sys 0.004s
I20260812 08:02:17.013020 11556 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:17.013474 11556 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee34e3c427f4a0e84020a51068e05c2, State: Initialized, Role: FOLLOWER
I20260812 08:02:17.013649 11556 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 260, Last appended: 1.261, Last appended by leader: 261, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:17.013975 11556 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 08:02:17.014730 10503 tablet_copy_service.cc:342] P 0b41f1db988e40f6ad6d850527f34c49: Request end of tablet copy session aee34e3c427f4a0e84020a51068e05c2-0e853fa7ef1d4cc184f3732c2c0a29da received from {username='slave'} at 127.8.228.2:32833
I20260812 08:02:17.014842 10503 tablet_copy_service.cc:434] P 0b41f1db988e40f6ad6d850527f34c49: ending tablet copy session aee34e3c427f4a0e84020a51068e05c2-0e853fa7ef1d4cc184f3732c2c0a29da on tablet 0e853fa7ef1d4cc184f3732c2c0a29da with peer aee34e3c427f4a0e84020a51068e05c2
I20260812 08:02:18.367003 11581 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b41f1db988e40f6ad6d850527f34c49)
I20260812 08:02:18.367146 11581 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:18.368517 11583 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b41f1db988e40f6ad6d850527f34c49)
I20260812 08:02:18.368830 11583 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:18.369037 11587 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b41f1db988e40f6ad6d850527f34c49)
I20260812 08:02:18.369156 11587 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:18.369419 11581 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:18.372735 11583 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375)
I20260812 08:02:18.373961 11587 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:18.373989 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:18.374130 10692 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 1.
I20260812 08:02:18.374738 11116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:18.374868 11116 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 1.
I20260812 08:02:18.375195 11234 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 62bf9cb31e88405295026392bbe46fc0, aee34e3c427f4a0e84020a51068e05c2, df58e7a1f88a4967a911c0fdb0bad058; no voters: 
I20260812 08:02:18.375422 11581 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:18.375487 11581 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b41f1db988e40f6ad6d850527f34c49)
I20260812 08:02:18.375540 11581 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:18.376628 11581 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:18.377127 11581 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 2 election: Requested vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:18.377362 11116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0"
I20260812 08:02:18.377410 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2"
I20260812 08:02:18.377458 11116 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:18.377521 10692 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:18.378577 10692 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 2.
I20260812 08:02:18.378931 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:18.379101 10467 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.265
I20260812 08:02:18.379215 10467 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 1.
I20260812 08:02:18.379467 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49"
I20260812 08:02:18.379559 10465 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.265
I20260812 08:02:18.379614 10465 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:18.380581 10465 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 2.
I20260812 08:02:18.381131 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:18.381349 11116 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 2.
I20260812 08:02:18.381788 11234 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 62bf9cb31e88405295026392bbe46fc0, aee34e3c427f4a0e84020a51068e05c2, df58e7a1f88a4967a911c0fdb0bad058; no voters: 
I20260812 08:02:18.381945 11581 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:18.382120 11581 raft_consensus.cc:697] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 LEADER]: Becoming Leader. State: Replica: df58e7a1f88a4967a911c0fdb0bad058, State: Running, Role: LEADER
I20260812 08:02:18.382465 11581 consensus_queue.cc:237] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 264, Committed index: 264, Last appended: 1.265, Last appended by leader: 265, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:18.383834 10897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:18.383948 10897 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 1.
I20260812 08:02:18.384155 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
I20260812 08:02:18.384253 10898 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:18.384397 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:18.384541 10692 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f984e61bbe3b49c5bbcfe042280b5f6f in current term 2: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:18.385212 10898 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 2.
I20260812 08:02:18.385298 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:18.385380 10465 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.265
I20260812 08:02:18.385478 10465 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f984e61bbe3b49c5bbcfe042280b5f6f in current term 2: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:18.386242 10790 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 0b41f1db988e40f6ad6d850527f34c49, 62bf9cb31e88405295026392bbe46fc0, aee34e3c427f4a0e84020a51068e05c2
I20260812 08:02:18.386646 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:18.386793 10898 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62bf9cb31e88405295026392bbe46fc0 in current term 2: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:18.387068 11583 raft_consensus.cc:2749] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:18.386991 10214 catalog_manager.cc:5719] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 reported cstate change: term changed from 1 to 2, leader changed from 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1) to df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5). New cstate: current_term: 2 leader_uuid: "df58e7a1f88a4967a911c0fdb0bad058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:18.387887 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:18.387966 10465 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.265
I20260812 08:02:18.388036 10465 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62bf9cb31e88405295026392bbe46fc0 in current term 2: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:18.388336 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:18.388351 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:18.388763 11009 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 62bf9cb31e88405295026392bbe46fc0; no voters: 0b41f1db988e40f6ad6d850527f34c49, df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f
I20260812 08:02:18.388967 11587 raft_consensus.cc:2749] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:18.390708 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 265 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:18.390820 10692 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62bf9cb31e88405295026392bbe46fc0 in current term 2: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:18.763309 11116 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Refusing update from remote peer df58e7a1f88a4967a911c0fdb0bad058: Log matching property violated. Preceding OpId in replica: term: 1 index: 265. Preceding OpId from leader: term: 2 index: 266. (index mismatch)
I20260812 08:02:18.763901 11633 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 266, Last known committed idx: 264, Time since last communication: 0.000s
W20260812 08:02:18.853012 11233 consensus_peers.cc:597] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 -> Peer 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325): Couldn't send request to peer 0b41f1db988e40f6ad6d850527f34c49. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:18.875854 10898 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Refusing update from remote peer df58e7a1f88a4967a911c0fdb0bad058: Log matching property violated. Preceding OpId in replica: term: 1 index: 265. Preceding OpId from leader: term: 2 index: 266. (index mismatch)
I20260812 08:02:18.876319 11633 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 266, Last known committed idx: 264, Time since last communication: 0.000s
I20260812 08:02:18.880203 10692 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Refusing update from remote peer df58e7a1f88a4967a911c0fdb0bad058: Log matching property violated. Preceding OpId in replica: term: 1 index: 261. Preceding OpId from leader: term: 2 index: 266. (index mismatch)
I20260812 08:02:18.881227 11633 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 266, Last known committed idx: 260, Time since last communication: 0.000s
I20260812 08:02:18.881273 11664 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:58450 (ReqId={client: 8955df605fd64c7e811238f9fe57c22f, seq_no=263, attempt_no=1}) took 2003 ms. Trace:
I20260812 08:02:18.881412 11664 rpcz_store.cc:276] 0812 08:02:16.877670 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:16.877730 (+    60us) service_pool.cc:224] Handling call
0812 08:02:18.881238 (+2003508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:02:18.888751  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 2.266 <uninitialized op> 2.266 2.266 2.266
I20260812 08:02:18.992707  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 2.266 <uninitialized op> 2.266 2.266 2.266
I20260812 08:02:19.196913  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 2.266 <uninitialized op> 2.266 2.266 2.266
I20260812 08:02:19.468647 11678 ts_tablet_manager.cc:933] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Initiating tablet copy from peer df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483)
I20260812 08:02:19.469180 11678 tablet_copy_client.cc:323] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.5:42483
I20260812 08:02:19.469862 11388 tablet_copy_service.cc:140] P df58e7a1f88a4967a911c0fdb0bad058: Received BeginTabletCopySession request for tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer 0b41f1db988e40f6ad6d850527f34c49 ({username='slave'} at 127.8.228.1:40307)
I20260812 08:02:19.469995 11388 tablet_copy_service.cc:161] P df58e7a1f88a4967a911c0fdb0bad058: Beginning new tablet copy session on tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer 0b41f1db988e40f6ad6d850527f34c49 at {username='slave'} at 127.8.228.1:40307: session id = 0b41f1db988e40f6ad6d850527f34c49-0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:19.471078 11388 tablet_copy_source_session.cc:215] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:19.472214 11678 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:19.473937 11678 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.265
I20260812 08:02:19.474105 11678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:19.475093 11678 tablet_copy_client.cc:806] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:19.475255 11678 tablet_copy_client.cc:670] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:19.477192 11678 tablet_copy_client.cc:538] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:19.478330 11678 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap starting.
I20260812 08:02:19.500666  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 2.266 <uninitialized op> 2.266 2.266 2.266
I20260812 08:02:19.619701 11678 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap replayed 1/1 log segments. Stats: ops{read=266 overwritten=0 applied=266 ignored=0} inserts{seen=264 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:19.620005 11678 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap complete.
I20260812 08:02:19.620230 11678 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Time spent bootstrapping tablet: real 0.142s	user 0.129s	sys 0.012s
I20260812 08:02:19.620757 11678 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:19.620867 11678 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b41f1db988e40f6ad6d850527f34c49, State: Initialized, Role: FOLLOWER
I20260812 08:02:19.621012 11678 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 266, Last appended: 2.266, Last appended by leader: 266, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:19.621359 11678 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 08:02:19.622081 11388 tablet_copy_service.cc:342] P df58e7a1f88a4967a911c0fdb0bad058: Request end of tablet copy session 0b41f1db988e40f6ad6d850527f34c49-0e853fa7ef1d4cc184f3732c2c0a29da received from {username='slave'} at 127.8.228.1:40307
I20260812 08:02:19.622219 11388 tablet_copy_service.cc:434] P df58e7a1f88a4967a911c0fdb0bad058: ending tablet copy session 0b41f1db988e40f6ad6d850527f34c49-0e853fa7ef1d4cc184f3732c2c0a29da on tablet 0e853fa7ef1d4cc184f3732c2c0a29da with peer 0b41f1db988e40f6ad6d850527f34c49
I20260812 08:02:19.884544 10465 raft_consensus.cc:1217] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.265->[2.266-2.266]   Dedup: 2.266->[]
I20260812 08:02:19.904268  9104 tablet_copy-itest.cc:761] Iteration 2
W20260812 08:02:19.910308 11042 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58450: Illegal state: replica 62bf9cb31e88405295026392bbe46fc0 is not leader of this config: current role FOLLOWER
W20260812 08:02:19.915740 10394 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36364: Illegal state: replica 0b41f1db988e40f6ad6d850527f34c49 is not leader of this config: current role FOLLOWER
I20260812 08:02:20.019383  9104 tablet_copy-itest.cc:780] Tombstoning follower tablet 0e853fa7ef1d4cc184f3732c2c0a29da on TS 0b41f1db988e40f6ad6d850527f34c49
I20260812 08:02:20.019897 10434 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:42206
I20260812 08:02:20.020206 11741 tablet_replica.cc:333] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: stopping tablet replica
I20260812 08:02:20.020330 11741 raft_consensus.cc:2243] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:20.021073 11741 raft_consensus.cc:2272] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 08:02:20.021260 11233 consensus_peers.cc:597] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 -> Peer 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325): Couldn't send request to peer 0b41f1db988e40f6ad6d850527f34c49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:20.022557 11741 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:20.025404 11741 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.287
I20260812 08:02:20.025542 11741 log.cc:1199] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/wal/wals/0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:20.634539 11633 consensus_queue.cc:799] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [LEADER]: Peer 0b41f1db988e40f6ad6d850527f34c49 is lagging by at least 86 ops behind the committed index 
I20260812 08:02:21.159305 11748 ts_tablet_manager.cc:933] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Initiating tablet copy from peer df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483)
I20260812 08:02:21.159714 11748 tablet_copy_client.cc:323] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.5:42483
I20260812 08:02:21.160768 11388 tablet_copy_service.cc:140] P df58e7a1f88a4967a911c0fdb0bad058: Received BeginTabletCopySession request for tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer 0b41f1db988e40f6ad6d850527f34c49 ({username='slave'} at 127.8.228.1:40307)
I20260812 08:02:21.160859 11388 tablet_copy_service.cc:161] P df58e7a1f88a4967a911c0fdb0bad058: Beginning new tablet copy session on tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer 0b41f1db988e40f6ad6d850527f34c49 at {username='slave'} at 127.8.228.1:40307: session id = 0b41f1db988e40f6ad6d850527f34c49-0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:21.161718 11388 tablet_copy_source_session.cc:215] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:21.162897 11748 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:21.164978 11748 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.287
I20260812 08:02:21.165166 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:21.166711  9104 tablet_copy-itest.cc:790] Tombstoning leader tablet 0e853fa7ef1d4cc184f3732c2c0a29da on TS df58e7a1f88a4967a911c0fdb0bad058
I20260812 08:02:21.168335 11309 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:37560
I20260812 08:02:21.168638 11748 tablet_copy_client.cc:806] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:21.168745 11752 tablet_replica.cc:333] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: stopping tablet replica
I20260812 08:02:21.168854 11748 tablet_copy_client.cc:670] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:21.169062 11752 raft_consensus.cc:2243] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 LEADER]: Raft consensus shutting down.
W20260812 08:02:21.169341 11696 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37570: Illegal state: RaftConsensus is not running: State = Stopping
I20260812 08:02:21.170899 11752 raft_consensus.cc:2272] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:21.171223 11748 tablet_copy_client.cc:538] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:21.172423 11748 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap starting.
I20260812 08:02:21.173611 11752 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:21.175746 11752 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.565
I20260812 08:02:21.175839 11752 log.cc:1199] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/wal/wals/0e853fa7ef1d4cc184f3732c2c0a29da
W20260812 08:02:21.179646 11042 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58450: Illegal state: replica 62bf9cb31e88405295026392bbe46fc0 is not leader of this config: current role FOLLOWER
W20260812 08:02:21.191391 10623 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35144: Illegal state: replica aee34e3c427f4a0e84020a51068e05c2 is not leader of this config: current role FOLLOWER
W20260812 08:02:21.201576 10834 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49750: Illegal state: replica f984e61bbe3b49c5bbcfe042280b5f6f is not leader of this config: current role FOLLOWER
I20260812 08:02:21.486591 11748 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap replayed 1/1 log segments. Stats: ops{read=564 overwritten=0 applied=563 ignored=0} inserts{seen=561 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:21.486902 11748 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Bootstrap complete.
I20260812 08:02:21.487092 11748 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Time spent bootstrapping tablet: real 0.315s	user 0.303s	sys 0.012s
I20260812 08:02:21.487481 11748 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:21.488009 11748 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b41f1db988e40f6ad6d850527f34c49, State: Initialized, Role: FOLLOWER
I20260812 08:02:21.488193 11748 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 563, Last appended: 2.564, Last appended by leader: 564, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:21.488602 11748 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 08:02:21.489135 11388 tablet_copy_service.cc:342] P df58e7a1f88a4967a911c0fdb0bad058: Request end of tablet copy session 0b41f1db988e40f6ad6d850527f34c49-0e853fa7ef1d4cc184f3732c2c0a29da received from {username='slave'} at 127.8.228.1:40307
I20260812 08:02:21.489223 11388 tablet_copy_service.cc:434] P df58e7a1f88a4967a911c0fdb0bad058: ending tablet copy session 0b41f1db988e40f6ad6d850527f34c49-0e853fa7ef1d4cc184f3732c2c0a29da on tablet 0e853fa7ef1d4cc184f3732c2c0a29da with peer 0b41f1db988e40f6ad6d850527f34c49
I20260812 08:02:22.667430 11766 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df58e7a1f88a4967a911c0fdb0bad058)
I20260812 08:02:22.667634 11766 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:22.667788 11767 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df58e7a1f88a4967a911c0fdb0bad058)
I20260812 08:02:22.667919 11767 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:22.668391 11766 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375)
I20260812 08:02:22.668787 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:22.668839 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:22.668959 10467 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 2.
I20260812 08:02:22.668952 11350 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.565
I20260812 08:02:22.669051 11350 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 2.
I20260812 08:02:22.669318 11116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:22.669454 11116 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 2.
I20260812 08:02:22.669564 10694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:22.669642 11767 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:22.669701 10694 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 2.
I20260812 08:02:22.670149 11769 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader df58e7a1f88a4967a911c0fdb0bad058)
I20260812 08:02:22.670256 11769 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:22.670565 10794 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 62bf9cb31e88405295026392bbe46fc0, df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 
I20260812 08:02:22.671020 11769 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:22.671239 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:22.671367 10898 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62bf9cb31e88405295026392bbe46fc0 in term 2.
I20260812 08:02:22.671551 11766 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:02:22.671612 11766 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Starting leader election (detected failure of leader df58e7a1f88a4967a911c0fdb0bad058)
I20260812 08:02:22.671645 11766 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:22.671810 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:22.671940 10467 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 2.
I20260812 08:02:22.672610 11766 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:22.673043 11766 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [CANDIDATE]: Term 3 election: Requested vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375)
I20260812 08:02:22.673476 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:22.673513 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49"
I20260812 08:02:22.673597 11350 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.565
I20260812 08:02:22.673629 11116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0"
I20260812 08:02:22.673651 10467 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:22.673689 11350 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62bf9cb31e88405295026392bbe46fc0 in term 2.
I20260812 08:02:22.673727 11116 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:22.674065 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:22.674198 10692 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62bf9cb31e88405295026392bbe46fc0 in term 2.
I20260812 08:02:22.674474 10694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2"
I20260812 08:02:22.674573 10694 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:22.674681 11008 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 62bf9cb31e88405295026392bbe46fc0, aee34e3c427f4a0e84020a51068e05c2, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 
I20260812 08:02:22.674849 11116 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 3.
I20260812 08:02:22.674865 10467 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 3.
I20260812 08:02:22.675020 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058"
I20260812 08:02:22.675113 11350 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.565
I20260812 08:02:22.675130 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "62bf9cb31e88405295026392bbe46fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:22.675185 11350 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:22.675259 10465 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62bf9cb31e88405295026392bbe46fc0 in current term 3: Already voted for candidate f984e61bbe3b49c5bbcfe042280b5f6f in this term.
I20260812 08:02:22.675581 10694 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 3.
I20260812 08:02:22.675737 10790 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 0b41f1db988e40f6ad6d850527f34c49, 62bf9cb31e88405295026392bbe46fc0, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 
I20260812 08:02:22.676203 11350 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f984e61bbe3b49c5bbcfe042280b5f6f in term 3.
I20260812 08:02:22.676496 11769 raft_consensus.cc:2764] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260812 08:02:22.676780 11766 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:02:22.676980 11766 raft_consensus.cc:697] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 LEADER]: Becoming Leader. State: Replica: f984e61bbe3b49c5bbcfe042280b5f6f, State: Running, Role: LEADER
I20260812 08:02:22.677327 11766 consensus_queue.cc:237] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 565, Committed index: 565, Last appended: 2.565, Last appended by leader: 565, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:22.679818 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:22.679935 11350 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 2.565
I20260812 08:02:22.680037 11350 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aee34e3c427f4a0e84020a51068e05c2 in current term 3: Already voted for candidate f984e61bbe3b49c5bbcfe042280b5f6f in this term.
I20260812 08:02:22.680563 10214 catalog_manager.cc:5719] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f reported cstate change: term changed from 2 to 3, leader changed from df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5) to f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3). New cstate: current_term: 3 leader_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:22.681247 11116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:22.681437 11116 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aee34e3c427f4a0e84020a51068e05c2 in current term 3: Already voted for candidate f984e61bbe3b49c5bbcfe042280b5f6f in this term.
I20260812 08:02:22.681967 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 3 candidate_status { last_received { term: 2 index: 565 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:22.682379 10576 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 0b41f1db988e40f6ad6d850527f34c49, aee34e3c427f4a0e84020a51068e05c2; no voters: 62bf9cb31e88405295026392bbe46fc0, df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f
I20260812 08:02:22.682668 11767 raft_consensus.cc:2749] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:22.717092 10694 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Refusing update from remote peer f984e61bbe3b49c5bbcfe042280b5f6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 565. Preceding OpId from leader: term: 3 index: 567. (index mismatch)
I20260812 08:02:22.717108 11116 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Refusing update from remote peer f984e61bbe3b49c5bbcfe042280b5f6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 565. Preceding OpId from leader: term: 3 index: 567. (index mismatch)
I20260812 08:02:22.717092 10465 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Refusing update from remote peer f984e61bbe3b49c5bbcfe042280b5f6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 564. Preceding OpId from leader: term: 3 index: 567. (index mismatch)
W20260812 08:02:22.717677 10797 consensus_peers.cc:597] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f -> Peer df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483): Couldn't send request to peer df58e7a1f88a4967a911c0fdb0bad058. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:22.717810 11794 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 566, Last known committed idx: 563, Time since last communication: 0.000s
I20260812 08:02:22.718207 11792 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 566, Last known committed idx: 565, Time since last communication: 0.000s
I20260812 08:02:22.718581 11779 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 566, Last known committed idx: 565, Time since last communication: 0.000s
I20260812 08:02:22.737036  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 3.567 3.567 3.567 <uninitialized op> 3.567
I20260812 08:02:22.841251  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 3.567 3.567 3.567 <uninitialized op> 3.567
I20260812 08:02:23.044976  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 3.567 3.567 3.567 <uninitialized op> 3.567
I20260812 08:02:23.137548 11812 ts_tablet_manager.cc:933] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Initiating tablet copy from peer f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:23.138109 11812 tablet_copy_client.cc:323] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.3:39447
I20260812 08:02:23.138823 10933 tablet_copy_service.cc:140] P f984e61bbe3b49c5bbcfe042280b5f6f: Received BeginTabletCopySession request for tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer df58e7a1f88a4967a911c0fdb0bad058 ({username='slave'} at 127.8.228.5:43579)
I20260812 08:02:23.138939 10933 tablet_copy_service.cc:161] P f984e61bbe3b49c5bbcfe042280b5f6f: Beginning new tablet copy session on tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer df58e7a1f88a4967a911c0fdb0bad058 at {username='slave'} at 127.8.228.5:43579: session id = df58e7a1f88a4967a911c0fdb0bad058-0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:23.140033 10933 tablet_copy_source_session.cc:215] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:23.141194 11812 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:23.142959 11812 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.565
I20260812 08:02:23.143111 11812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:23.144038 11812 tablet_copy_client.cc:806] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:23.144193 11812 tablet_copy_client.cc:670] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:23.147073 11812 tablet_copy_client.cc:538] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:23.148273 11812 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Bootstrap starting.
I20260812 08:02:23.348935  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 3.567 3.567 3.567 <uninitialized op> 3.567
I20260812 08:02:23.444743 11812 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Bootstrap replayed 1/1 log segments. Stats: ops{read=567 overwritten=0 applied=567 ignored=0} inserts{seen=564 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:23.445027 11812 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Bootstrap complete.
I20260812 08:02:23.445218 11812 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Time spent bootstrapping tablet: real 0.297s	user 0.282s	sys 0.012s
I20260812 08:02:23.445714 11812 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:23.445820 11812 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: df58e7a1f88a4967a911c0fdb0bad058, State: Initialized, Role: FOLLOWER
I20260812 08:02:23.445936 11812 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 567, Last appended: 3.567, Last appended by leader: 567, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:23.446218 11812 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 08:02:23.446955 10933 tablet_copy_service.cc:342] P f984e61bbe3b49c5bbcfe042280b5f6f: Request end of tablet copy session df58e7a1f88a4967a911c0fdb0bad058-0e853fa7ef1d4cc184f3732c2c0a29da received from {username='slave'} at 127.8.228.5:43579
I20260812 08:02:23.447065 10933 tablet_copy_service.cc:434] P f984e61bbe3b49c5bbcfe042280b5f6f: ending tablet copy session df58e7a1f88a4967a911c0fdb0bad058-0e853fa7ef1d4cc184f3732c2c0a29da on tablet 0e853fa7ef1d4cc184f3732c2c0a29da with peer df58e7a1f88a4967a911c0fdb0bad058
I20260812 08:02:23.540709 11350 raft_consensus.cc:1217] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 2.565->[3.566-3.567]   Dedup: 3.567->[]
I20260812 08:02:23.752648  9104 tablet_copy-itest.cc:761] Iteration 3
I20260812 08:02:23.858358  9104 tablet_copy-itest.cc:780] Tombstoning follower tablet 0e853fa7ef1d4cc184f3732c2c0a29da on TS 62bf9cb31e88405295026392bbe46fc0
I20260812 08:02:23.858923 11085 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:58446
I20260812 08:02:23.859539 11857 tablet_replica.cc:333] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: stopping tablet replica
I20260812 08:02:23.859903 11857 raft_consensus.cc:2243] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:23.860105 11857 pending_rounds.cc:70] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Trying to abort 1 pending ops.
I20260812 08:02:23.860253 11857 pending_rounds.cc:77] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Aborting op as it isn't in flight: id { term: 3 index: 588 } timestamp: 7317593062837145600 op_type: WRITE_OP write_request { tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\313\327\271\010\315\371\257f\000\000\000\000\000\000\000\000\000@\000\000\000\000\000\000" indirect_data: "<redacted>""0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7317593062819315712 authz_token { token_data: "\010\273\323\360\323\006\"3\n\005slave\022*\n f9b4efa9a61b48c3a2b6a4274493d05d\020\001\030\001 \001(\001" signature: "<redacted>""\204\376\316\021\313\365?\017w\031u%\243\013\024Q\010]v6\272a\312\270\272\303\226\372\220\202\247\213;>\257\216\366J\227=`\314U\354\366jy\314\235\016\220\365X\030J\021\354\212\250A\021\037R\306" signing_key_seq_num: 0 } } request_id { client_id: "8955df605fd64c7e811238f9fe57c22f" seq_no: 584 first_incomplete_seq_no: 584 attempt_no: 0 }
W20260812 08:02:23.861122 10794 consensus_peers.cc:597] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f -> Peer 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119): Couldn't send request to peer 62bf9cb31e88405295026392bbe46fc0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:23.861886 11857 raft_consensus.cc:2272] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:23.865602 11857 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:23.869314 11857 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.588
I20260812 08:02:23.869405 11857 log.cc:1199] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/wal/wals/0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:24.395774 11833 consensus_queue.cc:799] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [LEADER]: Peer 62bf9cb31e88405295026392bbe46fc0 is lagging by at least 69 ops behind the committed index 
I20260812 08:02:24.988375 11867 ts_tablet_manager.cc:933] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Initiating tablet copy from peer f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:24.989856 11867 tablet_copy_client.cc:323] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.3:39447
I20260812 08:02:24.990737 10933 tablet_copy_service.cc:140] P f984e61bbe3b49c5bbcfe042280b5f6f: Received BeginTabletCopySession request for tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer 62bf9cb31e88405295026392bbe46fc0 ({username='slave'} at 127.8.228.4:41181)
I20260812 08:02:24.990847 10933 tablet_copy_service.cc:161] P f984e61bbe3b49c5bbcfe042280b5f6f: Beginning new tablet copy session on tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer 62bf9cb31e88405295026392bbe46fc0 at {username='slave'} at 127.8.228.4:41181: session id = 62bf9cb31e88405295026392bbe46fc0-0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:24.991694 10933 tablet_copy_source_session.cc:215] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:24.992806 11867 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:24.995322  9104 tablet_copy-itest.cc:790] Tombstoning leader tablet 0e853fa7ef1d4cc184f3732c2c0a29da on TS f984e61bbe3b49c5bbcfe042280b5f6f
I20260812 08:02:24.995867 10868 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e853fa7ef1d4cc184f3732c2c0a29da with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:49734
I20260812 08:02:24.996085 11867 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 3.588
I20260812 08:02:24.996287 11867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:24.998035 11867 tablet_copy_client.cc:806] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:24.998273 11867 tablet_copy_client.cc:670] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:24.998574 11869 tablet_replica.cc:333] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: stopping tablet replica
I20260812 08:02:24.998905 11869 raft_consensus.cc:2243] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 LEADER]: Raft consensus shutting down.
I20260812 08:02:25.001122 11869 pending_rounds.cc:70] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Trying to abort 1 pending ops.
I20260812 08:02:25.001224 11869 pending_rounds.cc:77] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Aborting op as it isn't in flight: id { term: 3 index: 858 } timestamp: 7317593067511877632 op_type: WRITE_OP write_request { tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\373h\007\010\200\017\243\257\000\000\000\000\000\000\000\000\000@\000\000\000\000\000\000" indirect_data: "<redacted>""0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7317593067492184064 authz_token { token_data: "\010\273\323\360\323\006\"3\n\005slave\022*\n f9b4efa9a61b48c3a2b6a4274493d05d\020\001\030\001 \001(\001" signature: "<redacted>""\204\376\316\021\313\365?\017w\031u%\243\013\024Q\010]v6\272a\312\270\272\303\226\372\220\202\247\213;>\257\216\366J\227=`\314U\354\366jy\314\235\016\220\365X\030J\021\354\212\250A\021\037R\306" signing_key_seq_num: 0 } } request_id { client_id: "8955df605fd64c7e811238f9fe57c22f" seq_no: 854 first_incomplete_seq_no: 854 attempt_no: 0 }
W20260812 08:02:25.001549 11869 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49750: Aborted: Op aborted
I20260812 08:02:25.001819 11869 raft_consensus.cc:2272] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:25.002795 11867 tablet_copy_client.cc:538] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:25.004030 11867 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Bootstrap starting.
I20260812 08:02:25.004956 11869 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:25.006764 11869 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.858
I20260812 08:02:25.006840 11869 log.cc:1199] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/wal/wals/0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:25.458909 11867 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Bootstrap replayed 1/1 log segments. Stats: ops{read=856 overwritten=0 applied=856 ignored=0} inserts{seen=853 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:25.459201 11867 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Bootstrap complete.
I20260812 08:02:25.459443 11867 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Time spent bootstrapping tablet: real 0.455s	user 0.415s	sys 0.040s
I20260812 08:02:25.459969 11867 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:25.460079 11867 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62bf9cb31e88405295026392bbe46fc0, State: Initialized, Role: FOLLOWER
I20260812 08:02:25.460247 11867 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 856, Last appended: 3.856, Last appended by leader: 856, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:25.460577 11867 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 08:02:25.461174 10933 tablet_copy_service.cc:342] P f984e61bbe3b49c5bbcfe042280b5f6f: Request end of tablet copy session 62bf9cb31e88405295026392bbe46fc0-0e853fa7ef1d4cc184f3732c2c0a29da received from {username='slave'} at 127.8.228.4:41181
I20260812 08:02:25.461261 10933 tablet_copy_service.cc:434] P f984e61bbe3b49c5bbcfe042280b5f6f: ending tablet copy session 62bf9cb31e88405295026392bbe46fc0-0e853fa7ef1d4cc184f3732c2c0a29da on tablet 0e853fa7ef1d4cc184f3732c2c0a29da with peer 62bf9cb31e88405295026392bbe46fc0
I20260812 08:02:26.499684 11872 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f984e61bbe3b49c5bbcfe042280b5f6f)
I20260812 08:02:26.499812 11872 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:26.500186 11874 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f984e61bbe3b49c5bbcfe042280b5f6f)
I20260812 08:02:26.500298 11874 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:26.500420 11872 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:26.500792 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:26.500810 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:26.500911 11350 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 3.
I20260812 08:02:26.500631 11875 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f984e61bbe3b49c5bbcfe042280b5f6f)
I20260812 08:02:26.501199 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49" is_pre_election: true
I20260812 08:02:26.501308 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:26.501446 11119 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 3.
I20260812 08:02:26.501448 11875 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:26.501657 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:26.501793 10898 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 3.858
I20260812 08:02:26.501828 10465 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 3.
I20260812 08:02:26.501899 10898 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 3.
I20260812 08:02:26.501900 11874 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:26.502069 10897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:26.502170 10897 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 3.858
I20260812 08:02:26.502228 10576 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: aee34e3c427f4a0e84020a51068e05c2, df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 
I20260812 08:02:26.502298 10897 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 3.
I20260812 08:02:26.502435 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:26.502558 10692 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 3.
I20260812 08:02:26.502561 11234 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 62bf9cb31e88405295026392bbe46fc0, df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 0b41f1db988e40f6ad6d850527f34c49
I20260812 08:02:26.502682 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:26.502712 11872 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:02:26.502746 11874 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:02:26.502761 11872 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f984e61bbe3b49c5bbcfe042280b5f6f)
I20260812 08:02:26.502790 11874 raft_consensus.cc:493] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f984e61bbe3b49c5bbcfe042280b5f6f)
I20260812 08:02:26.502800 11872 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:02:26.502797 11119 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 3.
I20260812 08:02:26.502828 11874 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:02:26.503535 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0" is_pre_election: true
I20260812 08:02:26.503589 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2" is_pre_election: true
I20260812 08:02:26.503607 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058" is_pre_election: true
I20260812 08:02:26.503641 11119 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 3.
I20260812 08:02:26.503825 11875 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:26.504065 11872 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:26.504220 10897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "0b41f1db988e40f6ad6d850527f34c49" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" is_pre_election: true
I20260812 08:02:26.504268 10692 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b41f1db988e40f6ad6d850527f34c49 in current term 4: Already voted for candidate aee34e3c427f4a0e84020a51068e05c2 in this term.
I20260812 08:02:26.504315 10897 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 3.858
I20260812 08:02:26.504376 10897 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b41f1db988e40f6ad6d850527f34c49 in term 3.
I20260812 08:02:26.504359 11874 raft_consensus.cc:515] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:26.504531 11350 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b41f1db988e40f6ad6d850527f34c49 in current term 4: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:26.504840 10352 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 0b41f1db988e40f6ad6d850527f34c49, 62bf9cb31e88405295026392bbe46fc0, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: aee34e3c427f4a0e84020a51068e05c2, df58e7a1f88a4967a911c0fdb0bad058
I20260812 08:02:26.504973 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0"
I20260812 08:02:26.505064 11119 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:02:26.505158 11872 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [CANDIDATE]: Term 4 election: Requested vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), df58e7a1f88a4967a911c0fdb0bad058 (127.8.228.5:42483), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:26.505230 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49"
I20260812 08:02:26.505316 10465 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:02:26.505326 11116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "62bf9cb31e88405295026392bbe46fc0"
I20260812 08:02:26.505494 11874 leader_election.cc:290] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 4 election: Requested vote from peers 0b41f1db988e40f6ad6d850527f34c49 (127.8.228.1:38325), 62bf9cb31e88405295026392bbe46fc0 (127.8.228.4:38119), aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375), f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447)
I20260812 08:02:26.505679 10898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
I20260812 08:02:26.505754 10898 raft_consensus.cc:1803] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 3.858
I20260812 08:02:26.505802 10898 raft_consensus.cc:3060] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:02:26.505848 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "df58e7a1f88a4967a911c0fdb0bad058"
I20260812 08:02:26.505959 11350 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aee34e3c427f4a0e84020a51068e05c2 in current term 4: Already voted for candidate df58e7a1f88a4967a911c0fdb0bad058 in this term.
I20260812 08:02:26.506080 11119 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 4.
I20260812 08:02:26.506209 10897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "aee34e3c427f4a0e84020a51068e05c2" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f"
I20260812 08:02:26.506243 10465 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee34e3c427f4a0e84020a51068e05c2 in term 4.
I20260812 08:02:26.506778 10898 raft_consensus.cc:2468] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df58e7a1f88a4967a911c0fdb0bad058 in term 4.
I20260812 08:02:26.506805 10576 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 0b41f1db988e40f6ad6d850527f34c49, 62bf9cb31e88405295026392bbe46fc0, aee34e3c427f4a0e84020a51068e05c2; no voters: df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f
I20260812 08:02:26.506917 10465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "0b41f1db988e40f6ad6d850527f34c49"
I20260812 08:02:26.506985 11875 raft_consensus.cc:2764] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260812 08:02:26.506817 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e853fa7ef1d4cc184f3732c2c0a29da" candidate_uuid: "df58e7a1f88a4967a911c0fdb0bad058" candidate_term: 4 candidate_status { last_received { term: 3 index: 858 } } ignore_live_leader: false dest_uuid: "aee34e3c427f4a0e84020a51068e05c2"
I20260812 08:02:26.507170 11872 raft_consensus.cc:2804] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 08:02:26.507265 10465 raft_consensus.cc:2393] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate df58e7a1f88a4967a911c0fdb0bad058 in current term 4: Already voted for candidate aee34e3c427f4a0e84020a51068e05c2 in this term.
I20260812 08:02:26.507340 11872 raft_consensus.cc:697] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [term 4 LEADER]: Becoming Leader. State: Replica: aee34e3c427f4a0e84020a51068e05c2, State: Running, Role: LEADER
I20260812 08:02:26.507666 11872 consensus_queue.cc:237] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 857, Committed index: 857, Last appended: 3.858, Last appended by leader: 858, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:26.509284 11236 leader_election.cc:304] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: df58e7a1f88a4967a911c0fdb0bad058, f984e61bbe3b49c5bbcfe042280b5f6f; no voters: 0b41f1db988e40f6ad6d850527f34c49, 62bf9cb31e88405295026392bbe46fc0, aee34e3c427f4a0e84020a51068e05c2
I20260812 08:02:26.509443 11874 raft_consensus.cc:2749] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 08:02:26.510265 10218 catalog_manager.cc:5719] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 reported cstate change: term changed from 3 to 4, leader changed from f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3) to aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2). New cstate: current_term: 4 leader_uuid: "aee34e3c427f4a0e84020a51068e05c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:26.909307 10576 consensus_peers.cc:597] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 -> Peer f984e61bbe3b49c5bbcfe042280b5f6f (127.8.228.3:39447): Couldn't send request to peer f984e61bbe3b49c5bbcfe042280b5f6f. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:26.911547 11350 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P df58e7a1f88a4967a911c0fdb0bad058 [term 4 FOLLOWER]: Refusing update from remote peer aee34e3c427f4a0e84020a51068e05c2: Log matching property violated. Preceding OpId in replica: term: 3 index: 858. Preceding OpId from leader: term: 4 index: 859. (index mismatch)
I20260812 08:02:26.912017 11872 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 859, Last known committed idx: 857, Time since last communication: 0.000s
I20260812 08:02:26.960433 11119 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P 62bf9cb31e88405295026392bbe46fc0 [term 4 FOLLOWER]: Refusing update from remote peer aee34e3c427f4a0e84020a51068e05c2: Log matching property violated. Preceding OpId in replica: term: 3 index: 856. Preceding OpId from leader: term: 4 index: 859. (index mismatch)
I20260812 08:02:26.960899 11872 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 859, Last known committed idx: 856, Time since last communication: 0.000s
I20260812 08:02:26.965217 10465 raft_consensus.cc:1275] T 0e853fa7ef1d4cc184f3732c2c0a29da P 0b41f1db988e40f6ad6d850527f34c49 [term 4 FOLLOWER]: Refusing update from remote peer aee34e3c427f4a0e84020a51068e05c2: Log matching property violated. Preceding OpId in replica: term: 3 index: 858. Preceding OpId from leader: term: 4 index: 859. (index mismatch)
I20260812 08:02:26.965754 11899 consensus_queue.cc:1048] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 859, Last known committed idx: 857, Time since last communication: 0.000s
I20260812 08:02:26.967267 11902 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:36364 (ReqId={client: 8955df605fd64c7e811238f9fe57c22f, seq_no=854, attempt_no=1}) took 1961 ms. Trace:
I20260812 08:02:26.967412 11902 rpcz_store.cc:276] 0812 08:02:25.005419 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:25.005486 (+    67us) service_pool.cc:224] Handling call
0812 08:02:26.967226 (+1961740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:02:26.971553  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 4.859 4.859 4.859 4.859 <uninitialized op>
I20260812 08:02:27.074982  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 4.859 4.859 4.859 4.859 <uninitialized op>
I20260812 08:02:27.278872  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 4.859 4.859 4.859 4.859 <uninitialized op>
I20260812 08:02:27.525535 11910 ts_tablet_manager.cc:933] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Initiating tablet copy from peer aee34e3c427f4a0e84020a51068e05c2 (127.8.228.2:40375)
I20260812 08:02:27.526078 11910 tablet_copy_client.cc:323] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.2:40375
I20260812 08:02:27.526788 10719 tablet_copy_service.cc:140] P aee34e3c427f4a0e84020a51068e05c2: Received BeginTabletCopySession request for tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer f984e61bbe3b49c5bbcfe042280b5f6f ({username='slave'} at 127.8.228.3:53721)
I20260812 08:02:27.526908 10719 tablet_copy_service.cc:161] P aee34e3c427f4a0e84020a51068e05c2: Beginning new tablet copy session on tablet 0e853fa7ef1d4cc184f3732c2c0a29da from peer f984e61bbe3b49c5bbcfe042280b5f6f at {username='slave'} at 127.8.228.3:53721: session id = f984e61bbe3b49c5bbcfe042280b5f6f-0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:27.527874 10719 tablet_copy_source_session.cc:215] T 0e853fa7ef1d4cc184f3732c2c0a29da P aee34e3c427f4a0e84020a51068e05c2: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:27.528898 11910 ts_tablet_manager.cc:1916] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:27.530629 11910 ts_tablet_manager.cc:1929] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 3.858
I20260812 08:02:27.530804 11910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e853fa7ef1d4cc184f3732c2c0a29da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:27.531762 11910 tablet_copy_client.cc:806] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:27.531929 11910 tablet_copy_client.cc:670] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:27.534900 11910 tablet_copy_client.cc:538] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:27.536052 11910 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Bootstrap starting.
I20260812 08:02:27.582736  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 4.859 4.859 4.859 4.859 <uninitialized op>
I20260812 08:02:27.986304 11910 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=859 overwritten=0 applied=859 ignored=0} inserts{seen=855 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:27.986696 11910 tablet_bootstrap.cc:492] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Bootstrap complete.
I20260812 08:02:27.986692  9104 cluster_itest_util.cc:258] Not converged past 1 yet: 4.859 4.859 4.859 4.859 <uninitialized op>
I20260812 08:02:27.986954 11910 ts_tablet_manager.cc:1403] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Time spent bootstrapping tablet: real 0.451s	user 0.427s	sys 0.025s
I20260812 08:02:27.987468 11910 raft_consensus.cc:359] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:27.987576 11910 raft_consensus.cc:740] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: f984e61bbe3b49c5bbcfe042280b5f6f, State: Initialized, Role: FOLLOWER
I20260812 08:02:27.987721 11910 consensus_queue.cc:260] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 859, Last appended: 4.859, Last appended by leader: 859, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b41f1db988e40f6ad6d850527f34c49" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 38325 } } peers { permanent_uuid: "62bf9cb31e88405295026392bbe46fc0" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 38119 } } peers { permanent_uuid: "df58e7a1f88a4967a911c0fdb0bad058" member_type: VOTER last_known_addr { host: "127.8.228.5" port: 42483 } } peers { permanent_uuid: "aee34e3c427f4a0e84020a51068e05c2" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 40375 } } peers { permanent_uuid: "f984e61bbe3b49c5bbcfe042280b5f6f" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 39447 } }
I20260812 08:02:27.988039 11910 ts_tablet_manager.cc:1434] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:27.988718 10719 tablet_copy_service.cc:342] P aee34e3c427f4a0e84020a51068e05c2: Request end of tablet copy session f984e61bbe3b49c5bbcfe042280b5f6f-0e853fa7ef1d4cc184f3732c2c0a29da received from {username='slave'} at 127.8.228.3:53721
I20260812 08:02:27.988816 10719 tablet_copy_service.cc:434] P aee34e3c427f4a0e84020a51068e05c2: ending tablet copy session f984e61bbe3b49c5bbcfe042280b5f6f-0e853fa7ef1d4cc184f3732c2c0a29da on tablet 0e853fa7ef1d4cc184f3732c2c0a29da with peer f984e61bbe3b49c5bbcfe042280b5f6f
I20260812 08:02:28.141458 10898 raft_consensus.cc:1217] T 0e853fa7ef1d4cc184f3732c2c0a29da P f984e61bbe3b49c5bbcfe042280b5f6f [term 4 FOLLOWER]: Deduplicated request from leader. Original: 3.858->[4.859-4.859]   Dedup: 4.859->[]
I20260812 08:02:28.543709 11085 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:28.543720 10434 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:28.545050 10868 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:28.546516 11309 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:28.557837 10661 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 4d5bdf4060ae4aa3868e02299045271c | 127.8.228.62:43693 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                      Value                                                                                       |      Tags       |         Master
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                              | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                              | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                             | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                             | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                             | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                               | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                              | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:37029 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 0b41f1db988e40f6ad6d850527f34c49 | 127.8.228.1:38325 | HEALTHY | <none>   |       0        |       0
 62bf9cb31e88405295026392bbe46fc0 | 127.8.228.4:38119 | HEALTHY | <none>   |       0        |       0
 aee34e3c427f4a0e84020a51068e05c2 | 127.8.228.2:40375 | HEALTHY | <none>   |       1        |       0
 df58e7a1f88a4967a911c0fdb0bad058 | 127.8.228.5:42483 | HEALTHY | <none>   |       0        |       0
 f984e61bbe3b49c5bbcfe042280b5f6f | 127.8.228.3:39447 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       5

Unusual flags for Tablet Server:
               Flag               |                                                                                    Value                                                                                     |      Tags       |      Tablet Server
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                          | experimental    | all 5 server(s) checked
 local_ip_for_outbound_sockets    | 127.8.228.1                                                                                                                                                                  | experimental    | 127.8.228.1:38325
 local_ip_for_outbound_sockets    | 127.8.228.2                                                                                                                                                                  | experimental    | 127.8.228.2:40375
 local_ip_for_outbound_sockets    | 127.8.228.3                                                                                                                                                                  | experimental    | 127.8.228.3:39447
 local_ip_for_outbound_sockets    | 127.8.228.4                                                                                                                                                                  | experimental    | 127.8.228.4:38119
 local_ip_for_outbound_sockets    | 127.8.228.5                                                                                                                                                                  | experimental    | 127.8.228.5:42483
 never_fsync                      | true                                                                                                                                                                         | unsafe,advanced | all 5 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                            | unsafe,hidden   | all 5 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                         | unsafe          | all 5 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                           | hidden          | all 5 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.8.228.1:38325
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.8.228.2:40375
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.8.228.3:39447
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden          | 127.8.228.4:38119
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786521716701421-9104-0/minicluster-data/ts-4/data/info.pb | hidden          | 127.8.228.5:42483

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:37029 | all 5 server(s) checked
 time_source         | builtin            | all 5 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 6 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 5  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 5
 Tables         | 1
 Tablets        | 1
 Replicas       | 5

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:02:28.582294  9104 log_verifier.cc:126] Checking tablet 0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:28.924225  9104 log_verifier.cc:177] Verified matching terms for 859 ops in tablet 0e853fa7ef1d4cc184f3732c2c0a29da
I20260812 08:02:29.360245  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 10324
I20260812 08:02:29.376744  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 10550
I20260812 08:02:29.393564  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 10764
I20260812 08:02:29.410328  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 10984
I20260812 08:02:29.419389  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 11199
I20260812 08:02:29.434003  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 10165
2026-08-12T08:02:29Z chronyd exiting
[       OK ] TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest (15132 ms)
[ RUN      ] TabletCopyITest.TestTabletCopyThrottling
2026-08-12T08:02:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:29Z Disabled control of system clock
I20260812 08:02:29.472997  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:36647
--webserver_interface=127.8.228.62
--webserver_port=0
--builtin_ntp_servers=127.8.228.20:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:36647
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 08:02:29.572417 12002 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:29.572603 12002 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:29.572639 12002 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:29.575809 12002 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:29.575860 12002 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:29.575878 12002 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:29.575901 12002 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:29.579627 12002 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:36647
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:36647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.12002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:29.580541 12002 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:29.581559 12002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:29.586851 12007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.586864 12011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.586977 12002 server_base.cc:1061] running on GCE node
W20260812 08:02:29.586927 12015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.587510 12002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:29.588392 12002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:29.589561 12002 hybrid_clock.cc:648] HybridClock initialized: now 1786521749589522 us; error 55 us; skew 500 ppm
I20260812 08:02:29.591288 12002 webserver.cc:533] Webserver started at http://127.8.228.62:36827/ using document root <none> and password file <none>
I20260812 08:02:29.591810 12002 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:29.591866 12002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:29.592048 12002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:29.593464 12002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/instance:
uuid: "fb596f06090243fa976453addaa54090"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.593904 12002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal/instance:
uuid: "fb596f06090243fa976453addaa54090"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.596896 12002 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:29.598795 12022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.599648 12002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:29.599762 12002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "fb596f06090243fa976453addaa54090"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.599838 12002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:29.616411 12002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:29.616953 12002 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:29.617102 12002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:29.623652 12002 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:36647
I20260812 08:02:29.623649 12107 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:36647 every 8 connection(s)
I20260812 08:02:29.624532 12002 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:29.627161 12111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:29.627686  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 12002
I20260812 08:02:29.627810  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal/instance
I20260812 08:02:29.631920 12111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Bootstrap starting.
I20260812 08:02:29.633890 12111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:29.634596 12111 log.cc:826] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:29.636286 12111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: No bootstrap required, opened a new log
I20260812 08:02:29.638494 12111 raft_consensus.cc:359] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:29.638653 12111 raft_consensus.cc:385] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:29.638691 12111 raft_consensus.cc:740] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb596f06090243fa976453addaa54090, State: Initialized, Role: FOLLOWER
I20260812 08:02:29.638993 12111 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:29.639096 12111 raft_consensus.cc:399] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:29.639137 12111 raft_consensus.cc:493] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:29.639205 12111 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:29.639846 12111 raft_consensus.cc:515] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:29.640116 12111 leader_election.cc:304] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb596f06090243fa976453addaa54090; no voters: 
I20260812 08:02:29.640321 12111 leader_election.cc:290] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:29.640425 12117 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:29.640602 12117 raft_consensus.cc:697] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 LEADER]: Becoming Leader. State: Replica: fb596f06090243fa976453addaa54090, State: Running, Role: LEADER
I20260812 08:02:29.640905 12117 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:29.641316 12111 sys_catalog.cc:565] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:29.641947 12119 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb596f06090243fa976453addaa54090. Latest consensus state: current_term: 1 leader_uuid: "fb596f06090243fa976453addaa54090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } } }
I20260812 08:02:29.642096 12119 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:29.642409 12121 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb596f06090243fa976453addaa54090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } } }
I20260812 08:02:29.642549 12130 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:29.642588 12121 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:29.645705 12130 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:29.650493 12130 catalog_manager.cc:1383] Generated new cluster ID: bd8f91b1519d4ed787504621af055c8a
I20260812 08:02:29.650550 12130 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:29.659723 12130 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:29.660668 12130 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:29.669898 12130 catalog_manager.cc:6092] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Generated new TSK 0
I20260812 08:02:29.670432 12130 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:29.673774  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:0
--local_ip_for_outbound_sockets=127.8.228.1
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:36647
--builtin_ntp_servers=127.8.228.20:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=1 with env {}
W20260812 08:02:29.774605 12148 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:29.774793 12148 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:29.774855 12148 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:29.778043 12148 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:29.778162 12148 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:02:29.781818 12148 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:36647
--num_tablets_to_copy_simultaneously=1
--never_fsync=true
--heap_profile_path=/tmp/kudu.12148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:29.782768 12148 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:29.783779 12148 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:29.789937 12155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.789927 12158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.789928 12156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.790200 12148 server_base.cc:1061] running on GCE node
I20260812 08:02:29.790787 12148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:29.791431 12148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:29.792588 12148 hybrid_clock.cc:648] HybridClock initialized: now 1786521749792569 us; error 33 us; skew 500 ppm
I20260812 08:02:29.794667 12148 webserver.cc:533] Webserver started at http://127.8.228.1:42861/ using document root <none> and password file <none>
I20260812 08:02:29.795312 12148 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:29.795379 12148 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:29.795563 12148 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:29.797326 12148 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data/instance:
uuid: "dc5192dd7bc2483f85310e78fa29cfcf"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.797827 12148 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance:
uuid: "dc5192dd7bc2483f85310e78fa29cfcf"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.801569 12148 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:29.803910 12176 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.804894 12148 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:02:29.804992 12148 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "dc5192dd7bc2483f85310e78fa29cfcf"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.805069 12148 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:29.820717 12148 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:29.821696 12148 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:29.821981 12148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:29.822747 12148 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:29.823725 12148 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:29.823777 12148 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.823830 12148 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:29.823859 12148 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.832129 12148 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:35335
I20260812 08:02:29.832199 12388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:35335 every 8 connection(s)
I20260812 08:02:29.832993 12148 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:29.839913  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 12148
I20260812 08:02:29.840013  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:29.840504 12390 heartbeater.cc:344] Connected to a master server at 127.8.228.62:36647
I20260812 08:02:29.840720 12390 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:29.841229 12390 heartbeater.cc:507] Master 127.8.228.62:36647 requested a full tablet report, sending...
I20260812 08:02:29.842154  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:0
--local_ip_for_outbound_sockets=127.8.228.2
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:36647
--builtin_ntp_servers=127.8.228.20:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=1 with env {}
I20260812 08:02:29.842644 12047 ts_manager.cc:194] Registered new tserver with Master: dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1:35335)
I20260812 08:02:29.843848 12047 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:49419
W20260812 08:02:29.939733 12394 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:29.939893 12394 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:29.939932 12394 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:29.943094 12394 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:29.943193 12394 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:02:29.946722 12394 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:36647
--num_tablets_to_copy_simultaneously=1
--never_fsync=true
--heap_profile_path=/tmp/kudu.12394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:29.947512 12394 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:29.948415 12394 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:29.953845 12408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.953851 12403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.953851 12404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.954123 12394 server_base.cc:1061] running on GCE node
I20260812 08:02:29.954456 12394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:29.954912 12394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:29.956064 12394 hybrid_clock.cc:648] HybridClock initialized: now 1786521749956038 us; error 38 us; skew 500 ppm
I20260812 08:02:29.957577 12394 webserver.cc:533] Webserver started at http://127.8.228.2:46801/ using document root <none> and password file <none>
I20260812 08:02:29.958057 12394 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:29.958122 12394 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:29.958293 12394 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:29.959635 12394 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/instance:
uuid: "3535dfd0ecca4716b34fb2360de996b4"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.960040 12394 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance:
uuid: "3535dfd0ecca4716b34fb2360de996b4"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.963006 12394 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:29.964790 12421 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.965621 12394 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:29.965716 12394 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "3535dfd0ecca4716b34fb2360de996b4"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:29.965790 12394 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:29.978076 12394 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:29.978649 12394 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:29.978794 12394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:29.979259 12394 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:29.980082 12394 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:29.980137 12394 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.980185 12394 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:29.980209 12394 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.988375 12394 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:43835
I20260812 08:02:29.988401 12613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:43835 every 8 connection(s)
I20260812 08:02:29.989180 12394 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:29.996264 12614 heartbeater.cc:344] Connected to a master server at 127.8.228.62:36647
I20260812 08:02:29.996461 12614 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:29.996870 12614 heartbeater.cc:507] Master 127.8.228.62:36647 requested a full tablet report, sending...
I20260812 08:02:29.997745 12047 ts_manager.cc:194] Registered new tserver with Master: 3535dfd0ecca4716b34fb2360de996b4 (127.8.228.2:43835)
I20260812 08:02:29.998016  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 12394
I20260812 08:02:29.998111  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:29.998309 12047 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:41403
I20260812 08:02:30.000128  9104 external_mini_cluster.cc:955] 2 TS(s) registered with all masters
I20260812 08:02:30.007226  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 12394
I20260812 08:02:30.023586  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 12002
I20260812 08:02:30.034942  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:36647
--webserver_interface=127.8.228.62
--webserver_port=36827
--builtin_ntp_servers=127.8.228.20:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:36647
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 08:02:30.134779 12625 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:30.135017 12625 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:30.135068 12625 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:30.138238 12625 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:30.138286 12625 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:30.138306 12625 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:30.138356 12625 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:30.142004 12625 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:36647
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:36647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=36827
--never_fsync=true
--heap_profile_path=/tmp/kudu.12625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:30.142887 12625 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:30.143846 12625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:30.148576 12635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:30.148626 12639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:30.148790 12625 server_base.cc:1061] running on GCE node
W20260812 08:02:30.148844 12636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:30.149236 12625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:30.149992 12625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:30.151142 12625 hybrid_clock.cc:648] HybridClock initialized: now 1786521750151134 us; error 36 us; skew 500 ppm
I20260812 08:02:30.152664 12625 webserver.cc:533] Webserver started at http://127.8.228.62:36827/ using document root <none> and password file <none>
I20260812 08:02:30.153149 12625 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:30.153221 12625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:30.156256 12625 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:30.157912 12645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:30.158800 12625 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:30.158902 12625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "fb596f06090243fa976453addaa54090"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:30.159226 12625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:30.182243 12625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:30.182806 12625 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:30.182955 12625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:30.189507 12625 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:36647
I20260812 08:02:30.189507 12738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:36647 every 8 connection(s)
I20260812 08:02:30.190482 12625 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:30.194033 12739 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:02:30.195442 12739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Bootstrap starting.
I20260812 08:02:30.200129  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 12625
I20260812 08:02:30.209945 12739 log.cc:826] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:30.215236 12739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:30.215543 12739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Bootstrap complete.
I20260812 08:02:30.218559 12739 raft_consensus.cc:359] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:30.218859 12739 raft_consensus.cc:740] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb596f06090243fa976453addaa54090, State: Initialized, Role: FOLLOWER
I20260812 08:02:30.219233 12739 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:30.219353 12739 raft_consensus.cc:399] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:30.219410 12739 raft_consensus.cc:493] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:30.219511 12739 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:30.220858 12739 raft_consensus.cc:515] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:30.221161 12739 leader_election.cc:304] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb596f06090243fa976453addaa54090; no voters: 
I20260812 08:02:30.221397 12739 leader_election.cc:290] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 08:02:30.221517 12746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:30.221722 12746 raft_consensus.cc:697] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [term 2 LEADER]: Becoming Leader. State: Replica: fb596f06090243fa976453addaa54090, State: Running, Role: LEADER
I20260812 08:02:30.222011 12746 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } }
I20260812 08:02:30.222363 12739 sys_catalog.cc:565] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:30.223270 12747 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fb596f06090243fa976453addaa54090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } } }
I20260812 08:02:30.223394 12747 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:30.223644 12748 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb596f06090243fa976453addaa54090. Latest consensus state: current_term: 2 leader_uuid: "fb596f06090243fa976453addaa54090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb596f06090243fa976453addaa54090" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 36647 } } }
I20260812 08:02:30.223757 12748 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:30.223779 12765 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:30.226431 12765 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:30.227033 12765 catalog_manager.cc:1295] Loaded cluster ID: bd8f91b1519d4ed787504621af055c8a
I20260812 08:02:30.227094 12765 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:30.229203 12765 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:30.229844 12765 catalog_manager.cc:6103] T 00000000000000000000000000000000 P fb596f06090243fa976453addaa54090: Loaded TSK: 0
I20260812 08:02:30.230813 12765 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:30.845599 12390 heartbeater.cc:499] Master 127.8.228.62:36647 was elected leader, sending a full tablet report...
I20260812 08:02:30.849921 12678 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" instance_seqno: 1786521749829912) as {username='slave'} at 127.8.228.1:58693; Asking this server to re-register.
I20260812 08:02:30.850453 12390 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:30.850606 12390 heartbeater.cc:507] Master 127.8.228.62:36647 requested a full tablet report, sending...
I20260812 08:02:30.851522 12678 ts_manager.cc:194] Registered new tserver with Master: dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1:35335)
I20260812 08:02:30.856799  9104 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260812 08:02:30.866540 12678 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45588:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
  rows: "<redacted>""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:02:30.882792 12254 tablet_service.cc:1511] Processing CreateTablet for tablet b5ca632db4d7409f923b60da13c632a2 (DEFAULT_TABLE table=test-workload [id=3f7856ecdcd0404f8168a04fd9af6b4a]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20260812 08:02:30.882792 12253 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4f1e4d5fae414881442ade291368d6 (DEFAULT_TABLE table=test-workload [id=3f7856ecdcd0404f8168a04fd9af6b4a]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20260812 08:02:30.882795 12258 tablet_service.cc:1511] Processing CreateTablet for tablet 1965672b301948f88f4483a000c4f482 (DEFAULT_TABLE table=test-workload [id=3f7856ecdcd0404f8168a04fd9af6b4a]), partition=RANGE (key) PARTITION VALUES < 536870911
I20260812 08:02:30.882795 12255 tablet_service.cc:1511] Processing CreateTablet for tablet 99b7ba122dd84f6b846f51da87d48e3e (DEFAULT_TABLE table=test-workload [id=3f7856ecdcd0404f8168a04fd9af6b4a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20260812 08:02:30.884147 12254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ca632db4d7409f923b60da13c632a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:30.884533 12258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1965672b301948f88f4483a000c4f482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:30.884783 12255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b7ba122dd84f6b846f51da87d48e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:30.886469 12253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4f1e4d5fae414881442ade291368d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:30.890018 12799 tablet_bootstrap.cc:492] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: Bootstrap starting.
I20260812 08:02:30.891700 12799 tablet_bootstrap.cc:654] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:30.892649 12799 log.cc:826] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:30.894088 12799 tablet_bootstrap.cc:492] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: No bootstrap required, opened a new log
I20260812 08:02:30.894258 12799 ts_tablet_manager.cc:1403] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:02:30.896440 12799 raft_consensus.cc:359] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.896595 12799 raft_consensus.cc:385] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:30.896642 12799 raft_consensus.cc:740] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Initialized, Role: FOLLOWER
I20260812 08:02:30.897009 12799 consensus_queue.cc:260] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.897130 12799 raft_consensus.cc:399] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:30.897200 12799 raft_consensus.cc:493] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:30.897305 12799 raft_consensus.cc:3060] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:30.897987 12799 raft_consensus.cc:515] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.898289 12799 leader_election.cc:304] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc5192dd7bc2483f85310e78fa29cfcf; no voters: 
I20260812 08:02:30.898602 12799 leader_election.cc:290] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:30.898746 12802 raft_consensus.cc:2804] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:30.898958 12802 raft_consensus.cc:697] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 LEADER]: Becoming Leader. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Running, Role: LEADER
I20260812 08:02:30.899308 12802 consensus_queue.cc:237] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.899382 12799 ts_tablet_manager.cc:1434] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:02:30.899626 12799 tablet_bootstrap.cc:492] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf: Bootstrap starting.
I20260812 08:02:30.900585 12799 tablet_bootstrap.cc:654] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:30.901806 12799 tablet_bootstrap.cc:492] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf: No bootstrap required, opened a new log
I20260812 08:02:30.901890 12799 ts_tablet_manager.cc:1403] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:30.902431 12799 raft_consensus.cc:359] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.902540 12799 raft_consensus.cc:385] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:30.902616 12799 raft_consensus.cc:740] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Initialized, Role: FOLLOWER
I20260812 08:02:30.902762 12799 consensus_queue.cc:260] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.902844 12799 raft_consensus.cc:399] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:30.902915 12799 raft_consensus.cc:493] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:30.902967 12799 raft_consensus.cc:3060] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:30.902833 12678 catalog_manager.cc:5719] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1). New cstate: current_term: 1 leader_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:30.905519 12799 raft_consensus.cc:515] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.905648 12799 leader_election.cc:304] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc5192dd7bc2483f85310e78fa29cfcf; no voters: 
I20260812 08:02:30.905946 12799 leader_election.cc:290] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:30.906004 12802 raft_consensus.cc:2804] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:30.906103 12802 raft_consensus.cc:697] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 LEADER]: Becoming Leader. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Running, Role: LEADER
I20260812 08:02:30.906231 12799 ts_tablet_manager.cc:1434] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:02:30.906230 12802 consensus_queue.cc:237] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.906430 12799 tablet_bootstrap.cc:492] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf: Bootstrap starting.
I20260812 08:02:30.907325 12799 tablet_bootstrap.cc:654] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:30.907624 12678 catalog_manager.cc:5719] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1). New cstate: current_term: 1 leader_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:30.908568 12799 tablet_bootstrap.cc:492] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf: No bootstrap required, opened a new log
I20260812 08:02:30.908634 12799 ts_tablet_manager.cc:1403] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:30.909072 12799 raft_consensus.cc:359] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.909214 12799 raft_consensus.cc:385] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:30.909268 12799 raft_consensus.cc:740] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Initialized, Role: FOLLOWER
I20260812 08:02:30.909385 12799 consensus_queue.cc:260] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.909475 12799 raft_consensus.cc:399] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:30.909507 12799 raft_consensus.cc:493] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:30.909588 12799 raft_consensus.cc:3060] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:30.910151 12799 raft_consensus.cc:515] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.910254 12799 leader_election.cc:304] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc5192dd7bc2483f85310e78fa29cfcf; no voters: 
I20260812 08:02:30.910320 12799 leader_election.cc:290] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:30.910429 12809 raft_consensus.cc:2804] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:30.910507 12809 raft_consensus.cc:697] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [term 1 LEADER]: Becoming Leader. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Running, Role: LEADER
I20260812 08:02:30.910557 12799 ts_tablet_manager.cc:1434] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:30.910607 12809 consensus_queue.cc:237] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.910723 12799 tablet_bootstrap.cc:492] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf: Bootstrap starting.
I20260812 08:02:30.911578 12799 tablet_bootstrap.cc:654] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:30.911841 12678 catalog_manager.cc:5719] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1). New cstate: current_term: 1 leader_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:30.912483 12799 tablet_bootstrap.cc:492] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf: No bootstrap required, opened a new log
I20260812 08:02:30.912556 12799 ts_tablet_manager.cc:1403] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:30.913018 12799 raft_consensus.cc:359] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.913121 12799 raft_consensus.cc:385] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:30.913163 12799 raft_consensus.cc:740] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Initialized, Role: FOLLOWER
I20260812 08:02:30.913280 12799 consensus_queue.cc:260] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.913368 12799 raft_consensus.cc:399] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:30.913445 12799 raft_consensus.cc:493] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:30.913498 12799 raft_consensus.cc:3060] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:30.914149 12799 raft_consensus.cc:515] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.914271 12799 leader_election.cc:304] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc5192dd7bc2483f85310e78fa29cfcf; no voters: 
I20260812 08:02:30.914390 12799 leader_election.cc:290] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:30.914439 12809 raft_consensus.cc:2804] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:30.914537 12809 raft_consensus.cc:697] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [term 1 LEADER]: Becoming Leader. State: Replica: dc5192dd7bc2483f85310e78fa29cfcf, State: Running, Role: LEADER
I20260812 08:02:30.914640 12809 consensus_queue.cc:237] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:30.914692 12799 ts_tablet_manager.cc:1434] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:30.915874 12678 catalog_manager.cc:5719] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1). New cstate: current_term: 1 leader_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:31.629495  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:43835
--local_ip_for_outbound_sockets=127.8.228.2
--tserver_master_addrs=127.8.228.62:36647
--webserver_port=46801
--webserver_interface=127.8.228.2
--builtin_ntp_servers=127.8.228.20:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=1 with env {}
W20260812 08:02:31.729189 12855 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:31.729362 12855 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:31.729421 12855 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:31.732548 12855 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:31.732671 12855 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:02:31.736277 12855 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:43835
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=46801
--tserver_master_addrs=127.8.228.62:36647
--num_tablets_to_copy_simultaneously=1
--never_fsync=true
--heap_profile_path=/tmp/kudu.12855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:31.737172 12855 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:31.738153 12855 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:31.743891 12867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:31.743937 12866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:31.743920 12872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:31.744042 12855 server_base.cc:1061] running on GCE node
I20260812 08:02:31.744436 12855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:31.744910 12855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:31.746057 12855 hybrid_clock.cc:648] HybridClock initialized: now 1786521751746044 us; error 30 us; skew 500 ppm
I20260812 08:02:31.747635 12855 webserver.cc:533] Webserver started at http://127.8.228.2:46801/ using document root <none> and password file <none>
I20260812 08:02:31.748121 12855 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:31.748200 12855 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:31.751257 12855 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:02:31.752880 12881 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.753768 12855 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:02:31.753858 12855 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "3535dfd0ecca4716b34fb2360de996b4"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-6zbq"
I20260812 08:02:31.754200 12855 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:31.765674 12855 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:31.766165 12855 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:31.766312 12855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:31.766806 12855 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:31.767652 12855 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:31.767699 12855 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.767735 12855 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:31.767764 12855 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:31.776041 12855 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:43835
I20260812 08:02:31.776084 13068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:43835 every 8 connection(s)
I20260812 08:02:31.776896 12855 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:31.784335 13070 heartbeater.cc:344] Connected to a master server at 127.8.228.62:36647
I20260812 08:02:31.784534 13070 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:31.784962 13070 heartbeater.cc:507] Master 127.8.228.62:36647 requested a full tablet report, sending...
I20260812 08:02:31.785269  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 12855
I20260812 08:02:31.786026 12669 ts_manager.cc:194] Registered new tserver with Master: 3535dfd0ecca4716b34fb2360de996b4 (127.8.228.2:43835)
I20260812 08:02:31.787020 12669 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:59669
I20260812 08:02:31.791402 13078 ts_tablet_manager.cc:933] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Initiating tablet copy from peer dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1:35335)
I20260812 08:02:31.791831 13078 tablet_copy_client.cc:323] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.1:35335
I20260812 08:02:31.795223 12330 tablet_copy_service.cc:140] P dc5192dd7bc2483f85310e78fa29cfcf: Received BeginTabletCopySession request for tablet 1965672b301948f88f4483a000c4f482 from peer 3535dfd0ecca4716b34fb2360de996b4 ({username='slave'} at 127.8.228.2:54041)
I20260812 08:02:31.795341 12330 tablet_copy_service.cc:161] P dc5192dd7bc2483f85310e78fa29cfcf: Beginning new tablet copy session on tablet 1965672b301948f88f4483a000c4f482 from peer 3535dfd0ecca4716b34fb2360de996b4 at {username='slave'} at 127.8.228.2:54041: session id = 3535dfd0ecca4716b34fb2360de996b4-1965672b301948f88f4483a000c4f482
I20260812 08:02:31.796396 12330 tablet_copy_source_session.cc:215] T 1965672b301948f88f4483a000c4f482 P dc5192dd7bc2483f85310e78fa29cfcf: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:31.799216 13078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1965672b301948f88f4483a000c4f482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:31.803894 13078 tablet_copy_client.cc:806] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:31.804040 13078 tablet_copy_client.cc:670] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:31.806389 13078 tablet_copy_client.cc:538] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:31.807742 13078 tablet_bootstrap.cc:492] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap starting.
I20260812 08:02:31.829277 13078 log.cc:826] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:32.005450 13078 tablet_bootstrap.cc:492] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=2633 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:32.005824 13078 tablet_bootstrap.cc:492] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap complete.
I20260812 08:02:32.006220 13078 ts_tablet_manager.cc:1403] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Time spent bootstrapping tablet: real 0.199s	user 0.189s	sys 0.007s
I20260812 08:02:32.008637 13078 raft_consensus.cc:359] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.008896 13078 raft_consensus.cc:740] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 3535dfd0ecca4716b34fb2360de996b4, State: Initialized, Role: NON_PARTICIPANT
I20260812 08:02:32.009268 13078 consensus_queue.cc:260] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.009965 13070 heartbeater.cc:499] Master 127.8.228.62:36647 was elected leader, sending a full tablet report...
I20260812 08:02:32.010215 13078 ts_tablet_manager.cc:1434] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Time spent starting tablet: real 0.004s	user 0.007s	sys 0.000s
I20260812 08:02:32.010993 12330 tablet_copy_service.cc:342] P dc5192dd7bc2483f85310e78fa29cfcf: Request end of tablet copy session 3535dfd0ecca4716b34fb2360de996b4-1965672b301948f88f4483a000c4f482 received from {username='slave'} at 127.8.228.2:54041
I20260812 08:02:32.011111 12330 tablet_copy_service.cc:434] P dc5192dd7bc2483f85310e78fa29cfcf: ending tablet copy session 3535dfd0ecca4716b34fb2360de996b4-1965672b301948f88f4483a000c4f482 on tablet 1965672b301948f88f4483a000c4f482 with peer 3535dfd0ecca4716b34fb2360de996b4
W20260812 08:02:32.012964 13078 ts_tablet_manager.cc:732] T 1965672b301948f88f4483a000c4f482 P 3535dfd0ecca4716b34fb2360de996b4: Tablet Copy: Invalid argument: Leader has replica of tablet 1965672b301948f88f4483a000c4f482 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 08:02:32.014636 13078 ts_tablet_manager.cc:933] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Initiating tablet copy from peer dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1:35335)
I20260812 08:02:32.014889 13078 tablet_copy_client.cc:323] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.1:35335
I20260812 08:02:32.015391 12330 tablet_copy_service.cc:140] P dc5192dd7bc2483f85310e78fa29cfcf: Received BeginTabletCopySession request for tablet 8a4f1e4d5fae414881442ade291368d6 from peer 3535dfd0ecca4716b34fb2360de996b4 ({username='slave'} at 127.8.228.2:54041)
I20260812 08:02:32.015493 12330 tablet_copy_service.cc:161] P dc5192dd7bc2483f85310e78fa29cfcf: Beginning new tablet copy session on tablet 8a4f1e4d5fae414881442ade291368d6 from peer 3535dfd0ecca4716b34fb2360de996b4 at {username='slave'} at 127.8.228.2:54041: session id = 3535dfd0ecca4716b34fb2360de996b4-8a4f1e4d5fae414881442ade291368d6
I20260812 08:02:32.016209 12330 tablet_copy_source_session.cc:215] T 8a4f1e4d5fae414881442ade291368d6 P dc5192dd7bc2483f85310e78fa29cfcf: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:32.016929 13078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4f1e4d5fae414881442ade291368d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:32.018492 13078 tablet_copy_client.cc:806] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:32.018627 13078 tablet_copy_client.cc:670] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:32.020884 13078 tablet_copy_client.cc:538] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:32.022049 13078 tablet_bootstrap.cc:492] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap starting.
I20260812 08:02:32.214576 13078 tablet_bootstrap.cc:492] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=2666 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:32.214847 13078 tablet_bootstrap.cc:492] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap complete.
I20260812 08:02:32.215049 13078 ts_tablet_manager.cc:1403] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Time spent bootstrapping tablet: real 0.193s	user 0.193s	sys 0.000s
I20260812 08:02:32.215719 13078 raft_consensus.cc:359] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.215830 13078 raft_consensus.cc:740] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 3535dfd0ecca4716b34fb2360de996b4, State: Initialized, Role: NON_PARTICIPANT
I20260812 08:02:32.215947 13078 consensus_queue.cc:260] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.216219 13078 ts_tablet_manager.cc:1434] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:32.216771 12330 tablet_copy_service.cc:342] P dc5192dd7bc2483f85310e78fa29cfcf: Request end of tablet copy session 3535dfd0ecca4716b34fb2360de996b4-8a4f1e4d5fae414881442ade291368d6 received from {username='slave'} at 127.8.228.2:54041
I20260812 08:02:32.216858 12330 tablet_copy_service.cc:434] P dc5192dd7bc2483f85310e78fa29cfcf: ending tablet copy session 3535dfd0ecca4716b34fb2360de996b4-8a4f1e4d5fae414881442ade291368d6 on tablet 8a4f1e4d5fae414881442ade291368d6 with peer 3535dfd0ecca4716b34fb2360de996b4
W20260812 08:02:32.218720 13078 ts_tablet_manager.cc:732] T 8a4f1e4d5fae414881442ade291368d6 P 3535dfd0ecca4716b34fb2360de996b4: Tablet Copy: Invalid argument: Leader has replica of tablet 8a4f1e4d5fae414881442ade291368d6 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 08:02:32.219982 13078 ts_tablet_manager.cc:933] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Initiating tablet copy from peer dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1:35335)
I20260812 08:02:32.220261 13078 tablet_copy_client.cc:323] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.1:35335
I20260812 08:02:32.220688 12330 tablet_copy_service.cc:140] P dc5192dd7bc2483f85310e78fa29cfcf: Received BeginTabletCopySession request for tablet 99b7ba122dd84f6b846f51da87d48e3e from peer 3535dfd0ecca4716b34fb2360de996b4 ({username='slave'} at 127.8.228.2:54041)
I20260812 08:02:32.220778 12330 tablet_copy_service.cc:161] P dc5192dd7bc2483f85310e78fa29cfcf: Beginning new tablet copy session on tablet 99b7ba122dd84f6b846f51da87d48e3e from peer 3535dfd0ecca4716b34fb2360de996b4 at {username='slave'} at 127.8.228.2:54041: session id = 3535dfd0ecca4716b34fb2360de996b4-99b7ba122dd84f6b846f51da87d48e3e
I20260812 08:02:32.221506 12330 tablet_copy_source_session.cc:215] T 99b7ba122dd84f6b846f51da87d48e3e P dc5192dd7bc2483f85310e78fa29cfcf: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:32.222186 13078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b7ba122dd84f6b846f51da87d48e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:32.223714 13078 tablet_copy_client.cc:806] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:32.223861 13078 tablet_copy_client.cc:670] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:32.225418 13078 tablet_copy_client.cc:538] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:32.226406 13078 tablet_bootstrap.cc:492] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap starting.
I20260812 08:02:32.405566 13078 tablet_bootstrap.cc:492] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=2657 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:32.405839 13078 tablet_bootstrap.cc:492] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap complete.
I20260812 08:02:32.406032 13078 ts_tablet_manager.cc:1403] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Time spent bootstrapping tablet: real 0.180s	user 0.172s	sys 0.004s
I20260812 08:02:32.406518 13078 raft_consensus.cc:359] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.406623 13078 raft_consensus.cc:740] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 3535dfd0ecca4716b34fb2360de996b4, State: Initialized, Role: NON_PARTICIPANT
I20260812 08:02:32.406726 13078 consensus_queue.cc:260] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.407003 13078 ts_tablet_manager.cc:1434] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 08:02:32.407680 12330 tablet_copy_service.cc:342] P dc5192dd7bc2483f85310e78fa29cfcf: Request end of tablet copy session 3535dfd0ecca4716b34fb2360de996b4-99b7ba122dd84f6b846f51da87d48e3e received from {username='slave'} at 127.8.228.2:54041
I20260812 08:02:32.407780 12330 tablet_copy_service.cc:434] P dc5192dd7bc2483f85310e78fa29cfcf: ending tablet copy session 3535dfd0ecca4716b34fb2360de996b4-99b7ba122dd84f6b846f51da87d48e3e on tablet 99b7ba122dd84f6b846f51da87d48e3e with peer 3535dfd0ecca4716b34fb2360de996b4
W20260812 08:02:32.409679 13078 ts_tablet_manager.cc:732] T 99b7ba122dd84f6b846f51da87d48e3e P 3535dfd0ecca4716b34fb2360de996b4: Tablet Copy: Invalid argument: Leader has replica of tablet 99b7ba122dd84f6b846f51da87d48e3e with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 08:02:32.411154 13078 ts_tablet_manager.cc:933] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Initiating tablet copy from peer dc5192dd7bc2483f85310e78fa29cfcf (127.8.228.1:35335)
I20260812 08:02:32.411429 13078 tablet_copy_client.cc:323] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.1:35335
I20260812 08:02:32.411828 12330 tablet_copy_service.cc:140] P dc5192dd7bc2483f85310e78fa29cfcf: Received BeginTabletCopySession request for tablet b5ca632db4d7409f923b60da13c632a2 from peer 3535dfd0ecca4716b34fb2360de996b4 ({username='slave'} at 127.8.228.2:54041)
I20260812 08:02:32.411917 12330 tablet_copy_service.cc:161] P dc5192dd7bc2483f85310e78fa29cfcf: Beginning new tablet copy session on tablet b5ca632db4d7409f923b60da13c632a2 from peer 3535dfd0ecca4716b34fb2360de996b4 at {username='slave'} at 127.8.228.2:54041: session id = 3535dfd0ecca4716b34fb2360de996b4-b5ca632db4d7409f923b60da13c632a2
I20260812 08:02:32.412598 12330 tablet_copy_source_session.cc:215] T b5ca632db4d7409f923b60da13c632a2 P dc5192dd7bc2483f85310e78fa29cfcf: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:32.413215 13078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ca632db4d7409f923b60da13c632a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:32.414706 13078 tablet_copy_client.cc:806] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:32.414834 13078 tablet_copy_client.cc:670] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:32.416325 13078 tablet_copy_client.cc:538] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:32.417294 13078 tablet_bootstrap.cc:492] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap starting.
I20260812 08:02:32.586768 13078 tablet_bootstrap.cc:492] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=212 overwritten=0 applied=212 ignored=0} inserts{seen=2594 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:32.587038 13078 tablet_bootstrap.cc:492] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Bootstrap complete.
I20260812 08:02:32.587266 13078 ts_tablet_manager.cc:1403] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Time spent bootstrapping tablet: real 0.170s	user 0.162s	sys 0.008s
I20260812 08:02:32.587725 13078 raft_consensus.cc:359] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.587815 13078 raft_consensus.cc:740] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 3535dfd0ecca4716b34fb2360de996b4, State: Initialized, Role: NON_PARTICIPANT
I20260812 08:02:32.587901 13078 consensus_queue.cc:260] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 212, Last appended: 1.212, Last appended by leader: 212, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5192dd7bc2483f85310e78fa29cfcf" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 35335 } }
I20260812 08:02:32.588138 13078 ts_tablet_manager.cc:1434] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:32.588655 12330 tablet_copy_service.cc:342] P dc5192dd7bc2483f85310e78fa29cfcf: Request end of tablet copy session 3535dfd0ecca4716b34fb2360de996b4-b5ca632db4d7409f923b60da13c632a2 received from {username='slave'} at 127.8.228.2:54041
I20260812 08:02:32.588753 12330 tablet_copy_service.cc:434] P dc5192dd7bc2483f85310e78fa29cfcf: ending tablet copy session 3535dfd0ecca4716b34fb2360de996b4-b5ca632db4d7409f923b60da13c632a2 on tablet b5ca632db4d7409f923b60da13c632a2 with peer 3535dfd0ecca4716b34fb2360de996b4
W20260812 08:02:32.590879 13078 ts_tablet_manager.cc:732] T b5ca632db4d7409f923b60da13c632a2 P 3535dfd0ecca4716b34fb2360de996b4: Tablet Copy: Invalid argument: Leader has replica of tablet b5ca632db4d7409f923b60da13c632a2 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 08:02:32.592636  9104 tablet_copy-itest.cc:1252] Number of Service unavailable responses: 384
I20260812 08:02:32.592679  9104 tablet_copy-itest.cc:1253] Number of in progress responses: 299
I20260812 08:02:32.593159  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 12148
I20260812 08:02:32.619481  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 12855
I20260812 08:02:32.630388  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 12625
2026-08-12T08:02:32Z chronyd exiting
[       OK ] TabletCopyITest.TestTabletCopyThrottling (3194 ms)
[ RUN      ] TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate
2026-08-12T08:02:32Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:32Z Disabled control of system clock
I20260812 08:02:32.667822  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:38583
--webserver_interface=127.8.228.62
--webserver_port=0
--builtin_ntp_servers=127.8.228.20:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:38583 with env {}
W20260812 08:02:32.764668 13104 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:32.764832 13104 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:32.764868 13104 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:32.767969 13104 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:32.768014 13104 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:32.768033 13104 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:32.768064 13104 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:32.771616 13104 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:38583
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:38583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.13104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:32.772372 13104 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:32.773269 13104 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:32.777839 13111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:32.777848 13118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:32.777894 13113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:32.778115 13104 server_base.cc:1061] running on GCE node
I20260812 08:02:32.778579 13104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:32.779350 13104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:32.780503 13104 hybrid_clock.cc:648] HybridClock initialized: now 1786521752780491 us; error 30 us; skew 500 ppm
I20260812 08:02:32.781985 13104 webserver.cc:533] Webserver started at http://127.8.228.62:37743/ using document root <none> and password file <none>
I20260812 08:02:32.782495 13104 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:32.782552 13104 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:32.782720 13104 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:32.784027 13104 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/instance:
uuid: "804da5cd702c4474a142cc0c791a45e0"
format_stamp: "Formatted at 2026-08-12 08:02:32 on dist-test-slave-6zbq"
I20260812 08:02:32.784451 13104 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal/instance:
uuid: "804da5cd702c4474a142cc0c791a45e0"
format_stamp: "Formatted at 2026-08-12 08:02:32 on dist-test-slave-6zbq"
I20260812 08:02:32.787307 13104 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:32.789086 13127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:32.789916 13104 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:32.790014 13104 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "804da5cd702c4474a142cc0c791a45e0"
format_stamp: "Formatted at 2026-08-12 08:02:32 on dist-test-slave-6zbq"
I20260812 08:02:32.790093 13104 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:32.818145 13104 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:32.818738 13104 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:32.818890 13104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:32.825922 13104 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:38583
I20260812 08:02:32.825929 13220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:38583 every 8 connection(s)
I20260812 08:02:32.826846 13104 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:32.829406 13226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:32.832351  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 13104
I20260812 08:02:32.832468  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/wal/instance
I20260812 08:02:32.834170 13226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0: Bootstrap starting.
I20260812 08:02:32.836395 13226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:32.837072 13226 log.cc:826] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:32.838805 13226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0: No bootstrap required, opened a new log
I20260812 08:02:32.841434 13226 raft_consensus.cc:359] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804da5cd702c4474a142cc0c791a45e0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 38583 } }
I20260812 08:02:32.841596 13226 raft_consensus.cc:385] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:32.841655 13226 raft_consensus.cc:740] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 804da5cd702c4474a142cc0c791a45e0, State: Initialized, Role: FOLLOWER
I20260812 08:02:32.842003 13226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804da5cd702c4474a142cc0c791a45e0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 38583 } }
I20260812 08:02:32.842111 13226 raft_consensus.cc:399] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:32.842168 13226 raft_consensus.cc:493] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:32.842264 13226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:32.842981 13226 raft_consensus.cc:515] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804da5cd702c4474a142cc0c791a45e0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 38583 } }
I20260812 08:02:32.843271 13226 leader_election.cc:304] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 804da5cd702c4474a142cc0c791a45e0; no voters: 
I20260812 08:02:32.843510 13226 leader_election.cc:290] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:32.843609 13235 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:32.843822 13235 raft_consensus.cc:697] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [term 1 LEADER]: Becoming Leader. State: Replica: 804da5cd702c4474a142cc0c791a45e0, State: Running, Role: LEADER
I20260812 08:02:32.844090 13235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804da5cd702c4474a142cc0c791a45e0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 38583 } }
I20260812 08:02:32.844597 13226 sys_catalog.cc:565] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:32.845688 13239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 804da5cd702c4474a142cc0c791a45e0. Latest consensus state: current_term: 1 leader_uuid: "804da5cd702c4474a142cc0c791a45e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804da5cd702c4474a142cc0c791a45e0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 38583 } } }
I20260812 08:02:32.845822 13239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:32.846191 13258 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:32.846058 13242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "804da5cd702c4474a142cc0c791a45e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "804da5cd702c4474a142cc0c791a45e0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 38583 } } }
I20260812 08:02:32.846839 13242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:32.848959 13258 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:32.853264 13258 catalog_manager.cc:1383] Generated new cluster ID: d72d4a8df0c4463ab3026fb61b79990c
I20260812 08:02:32.853323 13258 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:32.867903 13258 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:32.868559 13258 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:32.875164 13258 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 804da5cd702c4474a142cc0c791a45e0: Generated new TSK 0
I20260812 08:02:32.875670 13258 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:32.884315  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:0
--local_ip_for_outbound_sockets=127.8.228.1
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:38583
--builtin_ntp_servers=127.8.228.20:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_flush_memrowset=false
--enable_flush_deltamemstores=false
--tablet_copy_download_threads_nums_per_session=4
--log_segment_size_mb=1 with env {}
W20260812 08:02:32.983971 13273 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:32.984140 13273 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:32.984181 13273 flags.cc:432] Enabled unsafe flag: --enable_flush_deltamemstores=false
W20260812 08:02:32.984203 13273 flags.cc:432] Enabled unsafe flag: --enable_flush_memrowset=false
W20260812 08:02:32.984243 13273 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:32.987407 13273 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:32.987521 13273 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:02:32.991112 13273 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=0
--enable_flush_deltamemstores=false
--enable_flush_memrowset=false
--tserver_master_addrs=127.8.228.62:38583
--never_fsync=true
--heap_profile_path=/tmp/kudu.13273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:32.991958 13273 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:32.992906 13273 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:32.998643 13278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:32.998643 13279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:32.998699 13281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:32.999068 13273 server_base.cc:1061] running on GCE node
I20260812 08:02:32.999387 13273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:32.999854 13273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:33.001017 13273 hybrid_clock.cc:648] HybridClock initialized: now 1786521753000986 us; error 44 us; skew 500 ppm
I20260812 08:02:33.002658 13273 webserver.cc:533] Webserver started at http://127.8.228.1:35033/ using document root <none> and password file <none>
I20260812 08:02:33.003160 13273 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:33.003217 13273 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:33.003391 13273 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:33.004781 13273 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/instance:
uuid: "5e47c4c2405947ccb3fc2f33a36d434f"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.005242 13273 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance:
uuid: "5e47c4c2405947ccb3fc2f33a36d434f"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.008234 13273 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:02:33.010149 13289 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.011054 13273 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:33.011173 13273 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "5e47c4c2405947ccb3fc2f33a36d434f"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.011252 13273 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:33.037190 13273 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:33.037784 13273 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:33.037942 13273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:33.038455 13273 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:33.039341 13273 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:33.039390 13273 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.039439 13273 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:33.039469 13273 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.048043 13273 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:39901
I20260812 08:02:33.048173 13498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:39901 every 8 connection(s)
I20260812 08:02:33.048992 13273 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:33.050637  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 13273
I20260812 08:02:33.050765  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:33.052850  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:0
--local_ip_for_outbound_sockets=127.8.228.2
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:38583
--builtin_ntp_servers=127.8.228.20:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_flush_memrowset=false
--enable_flush_deltamemstores=false
--tablet_copy_download_threads_nums_per_session=4
--log_segment_size_mb=1 with env {}
I20260812 08:02:33.056928 13499 heartbeater.cc:344] Connected to a master server at 127.8.228.62:38583
I20260812 08:02:33.057164 13499 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:33.057718 13499 heartbeater.cc:507] Master 127.8.228.62:38583 requested a full tablet report, sending...
I20260812 08:02:33.059099 13157 ts_manager.cc:194] Registered new tserver with Master: 5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1:39901)
I20260812 08:02:33.060163 13157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:38731
W20260812 08:02:33.152247 13503 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:33.152408 13503 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:33.152437 13503 flags.cc:432] Enabled unsafe flag: --enable_flush_deltamemstores=false
W20260812 08:02:33.152455 13503 flags.cc:432] Enabled unsafe flag: --enable_flush_memrowset=false
W20260812 08:02:33.152498 13503 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:33.155627 13503 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:33.155738 13503 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:02:33.159355 13503 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=0
--enable_flush_deltamemstores=false
--enable_flush_memrowset=false
--tserver_master_addrs=127.8.228.62:38583
--never_fsync=true
--heap_profile_path=/tmp/kudu.13503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:33.160182 13503 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:33.161156 13503 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:33.166724 13514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:33.166705 13515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:33.166772 13503 server_base.cc:1061] running on GCE node
W20260812 08:02:33.167011 13518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:33.167339 13503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:33.167809 13503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:33.168962 13503 hybrid_clock.cc:648] HybridClock initialized: now 1786521753168949 us; error 31 us; skew 500 ppm
I20260812 08:02:33.170463 13503 webserver.cc:533] Webserver started at http://127.8.228.2:38323/ using document root <none> and password file <none>
I20260812 08:02:33.170949 13503 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:33.171005 13503 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:33.171175 13503 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:33.172505 13503 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/instance:
uuid: "d4a22206472644538d5a4344421fdfeb"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.172926 13503 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance:
uuid: "d4a22206472644538d5a4344421fdfeb"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.175868 13503 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260812 08:02:33.177747 13527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.178668 13503 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:33.178766 13503 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "d4a22206472644538d5a4344421fdfeb"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.178843 13503 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:33.197901 13503 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:33.198427 13503 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:33.198566 13503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:33.199041 13503 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:33.199864 13503 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:33.199909 13503 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.199944 13503 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:33.199963 13503 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.208331 13503 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:46155
I20260812 08:02:33.208361 13732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:46155 every 8 connection(s)
I20260812 08:02:33.209141 13503 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:33.216044 13733 heartbeater.cc:344] Connected to a master server at 127.8.228.62:38583
I20260812 08:02:33.216243 13733 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:33.216668 13733 heartbeater.cc:507] Master 127.8.228.62:38583 requested a full tablet report, sending...
I20260812 08:02:33.217609 13157 ts_manager.cc:194] Registered new tserver with Master: d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155)
I20260812 08:02:33.218111 13157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:37775
I20260812 08:02:33.219015  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 13503
I20260812 08:02:33.219117  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:33.221037  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.3:0
--local_ip_for_outbound_sockets=127.8.228.3
--webserver_interface=127.8.228.3
--webserver_port=0
--tserver_master_addrs=127.8.228.62:38583
--builtin_ntp_servers=127.8.228.20:41335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_flush_memrowset=false
--enable_flush_deltamemstores=false
--tablet_copy_download_threads_nums_per_session=4
--log_segment_size_mb=1 with env {}
W20260812 08:02:33.318301 13739 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:33.318480 13739 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:33.318512 13739 flags.cc:432] Enabled unsafe flag: --enable_flush_deltamemstores=false
W20260812 08:02:33.318529 13739 flags.cc:432] Enabled unsafe flag: --enable_flush_memrowset=false
W20260812 08:02:33.318570 13739 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:33.321866 13739 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:33.321971 13739 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.3
I20260812 08:02:33.325569 13739 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:41335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.228.3
--webserver_port=0
--enable_flush_deltamemstores=false
--enable_flush_memrowset=false
--tserver_master_addrs=127.8.228.62:38583
--never_fsync=true
--heap_profile_path=/tmp/kudu.13739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:33.326519 13739 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:33.327502 13739 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:33.333164 13748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:33.333266 13739 server_base.cc:1061] running on GCE node
W20260812 08:02:33.333153 13755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:33.333137 13752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:33.333685 13739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:33.334164 13739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:33.335314 13739 hybrid_clock.cc:648] HybridClock initialized: now 1786521753335295 us; error 30 us; skew 500 ppm
I20260812 08:02:33.336836 13739 webserver.cc:533] Webserver started at http://127.8.228.3:40767/ using document root <none> and password file <none>
I20260812 08:02:33.337317 13739 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:33.337369 13739 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:33.337544 13739 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:33.339041 13739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/instance:
uuid: "4128644a40f7431b807c3e637d231ee5"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.339458 13739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance:
uuid: "4128644a40f7431b807c3e637d231ee5"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.342471 13739 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:33.344311 13762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.345158 13739 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:33.345273 13739 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal
uuid: "4128644a40f7431b807c3e637d231ee5"
format_stamp: "Formatted at 2026-08-12 08:02:33 on dist-test-slave-6zbq"
I20260812 08:02:33.345360 13739 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:33.355110 13739 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:33.355594 13739 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:33.355751 13739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:33.356202 13739 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:33.357059 13739 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:33.357105 13739 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.357151 13739 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:33.357180 13739 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.365796 13739 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.3:42689
I20260812 08:02:33.365867 13953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.3:42689 every 8 connection(s)
I20260812 08:02:33.366658 13739 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:33.373853 13954 heartbeater.cc:344] Connected to a master server at 127.8.228.62:38583
I20260812 08:02:33.374048 13954 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:33.374549 13954 heartbeater.cc:507] Master 127.8.228.62:38583 requested a full tablet report, sending...
I20260812 08:02:33.375499 13157 ts_manager.cc:194] Registered new tserver with Master: 4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689)
I20260812 08:02:33.375995 13157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.3:36689
I20260812 08:02:33.376906  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 13739
I20260812 08:02:33.377029  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:33.379128  9104 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:33.394526 13157 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38124:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:33.395500 13157 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:33.409951 13847 tablet_service.cc:1511] Processing CreateTablet for tablet 3aaef4faed6d42e6b0f053a5a7aa9422 (DEFAULT_TABLE table=test-workload [id=7caed47a9c9146fea3992a16096c2ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:33.410907 13847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaef4faed6d42e6b0f053a5a7aa9422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:33.411047 13606 tablet_service.cc:1511] Processing CreateTablet for tablet 3aaef4faed6d42e6b0f053a5a7aa9422 (DEFAULT_TABLE table=test-workload [id=7caed47a9c9146fea3992a16096c2ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:33.411346 13376 tablet_service.cc:1511] Processing CreateTablet for tablet 3aaef4faed6d42e6b0f053a5a7aa9422 (DEFAULT_TABLE table=test-workload [id=7caed47a9c9146fea3992a16096c2ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:33.411976 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaef4faed6d42e6b0f053a5a7aa9422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:33.412181 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaef4faed6d42e6b0f053a5a7aa9422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:33.415551 13991 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5: Bootstrap starting.
I20260812 08:02:33.417222 13995 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap starting.
I20260812 08:02:33.417599 13991 tablet_bootstrap.cc:654] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:33.417601 13994 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: Bootstrap starting.
I20260812 08:02:33.418494 13991 log.cc:826] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:33.419497 13994 tablet_bootstrap.cc:654] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:33.420166 13994 log.cc:826] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:33.420246 13991 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5: No bootstrap required, opened a new log
I20260812 08:02:33.420295 13995 tablet_bootstrap.cc:654] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:33.420418 13991 ts_tablet_manager.cc:1403] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20260812 08:02:33.421065 13995 log.cc:826] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:33.421679 13994 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: No bootstrap required, opened a new log
I20260812 08:02:33.421876 13994 ts_tablet_manager.cc:1403] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:33.422664 13995 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: No bootstrap required, opened a new log
I20260812 08:02:33.422834 13995 ts_tablet_manager.cc:1403] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:33.423302 13991 raft_consensus.cc:359] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.423503 13991 raft_consensus.cc:385] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:33.423627 13991 raft_consensus.cc:740] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4128644a40f7431b807c3e637d231ee5, State: Initialized, Role: FOLLOWER
I20260812 08:02:33.424227 13994 raft_consensus.cc:359] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.424378 13994 raft_consensus.cc:385] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:33.424450 13994 raft_consensus.cc:740] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e47c4c2405947ccb3fc2f33a36d434f, State: Initialized, Role: FOLLOWER
I20260812 08:02:33.424811 13994 consensus_queue.cc:260] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.424834 13991 consensus_queue.cc:260] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.425397 13499 heartbeater.cc:499] Master 127.8.228.62:38583 was elected leader, sending a full tablet report...
I20260812 08:02:33.425614 13994 ts_tablet_manager.cc:1434] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:02:33.425628 13991 ts_tablet_manager.cc:1434] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:02:33.425637 13995 raft_consensus.cc:359] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.425802 13995 raft_consensus.cc:385] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:33.425848 13995 raft_consensus.cc:740] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4a22206472644538d5a4344421fdfeb, State: Initialized, Role: FOLLOWER
I20260812 08:02:33.425928 13954 heartbeater.cc:499] Master 127.8.228.62:38583 was elected leader, sending a full tablet report...
I20260812 08:02:33.426167 13995 consensus_queue.cc:260] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.426810 13733 heartbeater.cc:499] Master 127.8.228.62:38583 was elected leader, sending a full tablet report...
I20260812 08:02:33.426890 13995 ts_tablet_manager.cc:1434] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260812 08:02:33.457067 14003 raft_consensus.cc:493] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:33.457190 14003 raft_consensus.cc:515] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.458048 14003 leader_election.cc:290] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689), d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155)
W20260812 08:02:33.459916 13734 tablet.cc:2406] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:33.460078 13734 tablet_replica_mm_ops.cc:240] Deltamemstore flush is disabled (check --enable_flush_deltamemstores)
W20260812 08:02:33.460119 13734 tablet_replica_mm_ops.cc:163] Memrowset flush is disabled (check --enable_flush_memrowset)
I20260812 08:02:33.461963 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422" candidate_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4128644a40f7431b807c3e637d231ee5" is_pre_election: true
I20260812 08:02:33.462205 13883 raft_consensus.cc:2468] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e47c4c2405947ccb3fc2f33a36d434f in term 0.
I20260812 08:02:33.462268 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422" candidate_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4a22206472644538d5a4344421fdfeb" is_pre_election: true
I20260812 08:02:33.462515 13641 raft_consensus.cc:2468] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e47c4c2405947ccb3fc2f33a36d434f in term 0.
I20260812 08:02:33.462690 13298 leader_election.cc:304] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4128644a40f7431b807c3e637d231ee5, 5e47c4c2405947ccb3fc2f33a36d434f; no voters: 
I20260812 08:02:33.462915 14003 raft_consensus.cc:2804] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:33.462993 14003 raft_consensus.cc:493] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:33.463040 14003 raft_consensus.cc:3060] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:33.463758 14003 raft_consensus.cc:515] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.464042 14003 leader_election.cc:290] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [CANDIDATE]: Term 1 election: Requested vote from peers 4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689), d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155)
I20260812 08:02:33.464389 13883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422" candidate_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4128644a40f7431b807c3e637d231ee5"
I20260812 08:02:33.464398 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422" candidate_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4a22206472644538d5a4344421fdfeb"
I20260812 08:02:33.464500 13641 raft_consensus.cc:3060] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:33.464524 13883 raft_consensus.cc:3060] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:33.465531 13641 raft_consensus.cc:2468] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e47c4c2405947ccb3fc2f33a36d434f in term 1.
I20260812 08:02:33.465830 13296 leader_election.cc:304] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e47c4c2405947ccb3fc2f33a36d434f, d4a22206472644538d5a4344421fdfeb; no voters: 
I20260812 08:02:33.465852 13883 raft_consensus.cc:2468] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e47c4c2405947ccb3fc2f33a36d434f in term 1.
I20260812 08:02:33.466058 14003 raft_consensus.cc:2804] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:33.466243 14003 raft_consensus.cc:697] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 LEADER]: Becoming Leader. State: Replica: 5e47c4c2405947ccb3fc2f33a36d434f, State: Running, Role: LEADER
I20260812 08:02:33.466522 14003 consensus_queue.cc:237] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:33.468842 13156 catalog_manager.cc:5719] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1). New cstate: current_term: 1 leader_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:33.488746 13641 raft_consensus.cc:1275] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Refusing update from remote peer 5e47c4c2405947ccb3fc2f33a36d434f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:33.488750 13883 raft_consensus.cc:1275] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 1 FOLLOWER]: Refusing update from remote peer 5e47c4c2405947ccb3fc2f33a36d434f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:33.489368 14007 consensus_queue.cc:1048] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:33.489497 14003 consensus_queue.cc:1048] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:33.495862 14015 mvcc.cc:204] Tried to move back new op lower bound from 7317593102284017664 to 7317593102201135104. Current Snapshot: MvccSnapshot[applied={T|T < 7317593102284017664}]
I20260812 08:02:33.498324 14020 mvcc.cc:204] Tried to move back new op lower bound from 7317593102284017664 to 7317593102201135104. Current Snapshot: MvccSnapshot[applied={T|T < 7317593102284017664 or (T in {7317593102284017664})}]
I20260812 08:02:33.511951 13409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422"
dest_uuid: "5e47c4c2405947ccb3fc2f33a36d434f"
 from {username='slave'} at 127.0.0.1:42284
I20260812 08:02:33.512099 13409 raft_consensus.cc:476] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 LEADER]: Not starting forced leader election -- already a leader
W20260812 08:02:33.550258 13500 tablet_replica_mm_ops.cc:240] Deltamemstore flush is disabled (check --enable_flush_deltamemstores)
W20260812 08:02:33.550319 13500 tablet_replica_mm_ops.cc:163] Memrowset flush is disabled (check --enable_flush_memrowset)
W20260812 08:02:33.617666 13955 tablet_replica_mm_ops.cc:240] Deltamemstore flush is disabled (check --enable_flush_deltamemstores)
W20260812 08:02:33.617738 13955 tablet_replica_mm_ops.cc:163] Memrowset flush is disabled (check --enable_flush_memrowset)
I20260812 08:02:46.568972 13606 tablet_service.cc:1558] Processing DeleteTablet for tablet 3aaef4faed6d42e6b0f053a5a7aa9422 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:34648
I20260812 08:02:46.569445 14132 tablet_replica.cc:333] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: stopping tablet replica
I20260812 08:02:46.569700 14132 raft_consensus.cc:2243] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:46.569936 14132 raft_consensus.cc:2272] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:46.572072 14132 ts_tablet_manager.cc:1916] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:46.573922 14132 ts_tablet_manager.cc:1929] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2486
I20260812 08:02:46.574004 14132 log.cc:1199] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/wal/wals/3aaef4faed6d42e6b0f053a5a7aa9422
W20260812 08:02:46.871625 13296 consensus_peers.cc:597] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f -> Peer d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155): Couldn't send request to peer d4a22206472644538d5a4344421fdfeb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:47.341780 14138 ts_tablet_manager.cc:933] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Initiating tablet copy from peer 5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1:39901)
I20260812 08:02:47.342478 14138 tablet_copy_client.cc:323] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.1:39901
I20260812 08:02:47.345863 13444 tablet_copy_service.cc:140] P 5e47c4c2405947ccb3fc2f33a36d434f: Received BeginTabletCopySession request for tablet 3aaef4faed6d42e6b0f053a5a7aa9422 from peer d4a22206472644538d5a4344421fdfeb ({username='slave'} at 127.8.228.2:36339)
I20260812 08:02:47.345978 13444 tablet_copy_service.cc:161] P 5e47c4c2405947ccb3fc2f33a36d434f: Beginning new tablet copy session on tablet 3aaef4faed6d42e6b0f053a5a7aa9422 from peer d4a22206472644538d5a4344421fdfeb at {username='slave'} at 127.8.228.2:36339: session id = d4a22206472644538d5a4344421fdfeb-3aaef4faed6d42e6b0f053a5a7aa9422
I20260812 08:02:47.347138 13444 tablet_copy_source_session.cc:215] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f: Tablet Copy: opened 0 blocks and 5 log segments
I20260812 08:02:47.348371 14138 ts_tablet_manager.cc:1916] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:47.350061 14138 ts_tablet_manager.cc:1929] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.2486
I20260812 08:02:47.350250 14138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aaef4faed6d42e6b0f053a5a7aa9422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:47.351226 14138 tablet_copy_client.cc:806] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:47.351388 14138 tablet_copy_client.cc:670] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: tablet copy: Starting download of 5 WAL segments...
I20260812 08:02:47.363088 14138 tablet_copy_client.cc:538] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:47.364440 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap starting.
I20260812 08:02:48.016418 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap replayed 1/5 log segments. Stats: ops{read=621 overwritten=0 applied=620 ignored=0} inserts{seen=1 ignored=0} mutations{seen=30900 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:48.660274 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap replayed 2/5 log segments. Stats: ops{read=1240 overwritten=0 applied=1239 ignored=0} inserts{seen=1 ignored=0} mutations{seen=61850 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:49.305137 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap replayed 3/5 log segments. Stats: ops{read=1859 overwritten=0 applied=1858 ignored=0} inserts{seen=1 ignored=0} mutations{seen=92800 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:49.945410 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap replayed 4/5 log segments. Stats: ops{read=2478 overwritten=0 applied=2477 ignored=0} inserts{seen=1 ignored=0} mutations{seen=123750 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:02:49.955348 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap replayed 5/5 log segments. Stats: ops{read=2486 overwritten=0 applied=2486 ignored=0} inserts{seen=1 ignored=0} mutations{seen=124200 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:49.955688 14138 tablet_bootstrap.cc:492] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Bootstrap complete.
I20260812 08:02:49.956885 14138 ts_tablet_manager.cc:1403] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Time spent bootstrapping tablet: real 2.592s	user 2.499s	sys 0.092s
I20260812 08:02:49.957410 14138 raft_consensus.cc:359] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:49.957516 14138 raft_consensus.cc:740] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4a22206472644538d5a4344421fdfeb, State: Initialized, Role: FOLLOWER
I20260812 08:02:49.957654 14138 consensus_queue.cc:260] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2486, Last appended: 1.2486, Last appended by leader: 2486, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:49.957965 14138 ts_tablet_manager.cc:1434] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 08:02:49.958648 13437 tablet_copy_service.cc:342] P 5e47c4c2405947ccb3fc2f33a36d434f: Request end of tablet copy session d4a22206472644538d5a4344421fdfeb-3aaef4faed6d42e6b0f053a5a7aa9422 received from {username='slave'} at 127.8.228.2:36339
I20260812 08:02:49.958758 13437 tablet_copy_service.cc:434] P 5e47c4c2405947ccb3fc2f33a36d434f: ending tablet copy session d4a22206472644538d5a4344421fdfeb-3aaef4faed6d42e6b0f053a5a7aa9422 on tablet 3aaef4faed6d42e6b0f053a5a7aa9422 with peer d4a22206472644538d5a4344421fdfeb
I20260812 08:02:49.967900 13640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422"
dest_uuid: "d4a22206472644538d5a4344421fdfeb"
 from {username='slave'} at 127.0.0.1:34648
I20260812 08:02:49.968025 13640 raft_consensus.cc:493] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:49.968076 13640 raft_consensus.cc:3060] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:49.968770 13640 raft_consensus.cc:515] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:49.969655 13640 leader_election.cc:290] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [CANDIDATE]: Term 2 election: Requested vote from peers 4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689), 5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1:39901)
I20260812 08:02:49.970098 13409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422" candidate_uuid: "d4a22206472644538d5a4344421fdfeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2486 } } ignore_live_leader: true dest_uuid: "5e47c4c2405947ccb3fc2f33a36d434f"
I20260812 08:02:49.970279 13409 raft_consensus.cc:3055] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:49.970360 13409 raft_consensus.cc:740] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e47c4c2405947ccb3fc2f33a36d434f, State: Running, Role: LEADER
I20260812 08:02:49.970541 13409 consensus_queue.cc:260] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2486, Committed index: 2486, Last appended: 1.2486, Last appended by leader: 2486, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:49.970850 13409 raft_consensus.cc:3060] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:49.971935 13409 raft_consensus.cc:2468] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4a22206472644538d5a4344421fdfeb in term 2.
I20260812 08:02:49.972291 13531 leader_election.cc:304] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e47c4c2405947ccb3fc2f33a36d434f, d4a22206472644538d5a4344421fdfeb; no voters: 
I20260812 08:02:49.972520 14165 raft_consensus.cc:2804] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:49.972687 14165 raft_consensus.cc:697] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [term 2 LEADER]: Becoming Leader. State: Replica: d4a22206472644538d5a4344421fdfeb, State: Running, Role: LEADER
I20260812 08:02:49.972944 14165 consensus_queue.cc:237] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2486, Committed index: 2486, Last appended: 1.2486, Last appended by leader: 2486, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } }
I20260812 08:02:49.973685 13882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aaef4faed6d42e6b0f053a5a7aa9422" candidate_uuid: "d4a22206472644538d5a4344421fdfeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2486 } } ignore_live_leader: true dest_uuid: "4128644a40f7431b807c3e637d231ee5"
I20260812 08:02:49.973827 13882 raft_consensus.cc:3060] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:49.974674 13882 raft_consensus.cc:2468] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4a22206472644538d5a4344421fdfeb in term 2.
I20260812 08:02:49.975116 13143 catalog_manager.cc:5719] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb reported cstate change: term changed from 1 to 2, leader changed from 5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1) to d4a22206472644538d5a4344421fdfeb (127.8.228.2). New cstate: current_term: 2 leader_uuid: "d4a22206472644538d5a4344421fdfeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4a22206472644538d5a4344421fdfeb" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 46155 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:50.021736 13376 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.022003 13847 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.023700 13606 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 804da5cd702c4474a142cc0c791a45e0 | 127.8.228.62:38583 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                     Value                                                                                      |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                           | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                              | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                           | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                           | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                             | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                            | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4128644a40f7431b807c3e637d231ee5 | 127.8.228.3:42689 | HEALTHY | <none>   |       0        |       0
 5e47c4c2405947ccb3fc2f33a36d434f | 127.8.228.1:39901 | HEALTHY | <none>   |       0        |       0
 d4a22206472644538d5a4344421fdfeb | 127.8.228.2:46155 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                   Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                        | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.8.228.1                                                                                                                                                                | experimental    | 127.8.228.1:39901
 local_ip_for_outbound_sockets    | 127.8.228.2                                                                                                                                                                | experimental    | 127.8.228.2:46155
 local_ip_for_outbound_sockets    | 127.8.228.3                                                                                                                                                                | experimental    | 127.8.228.3:42689
 never_fsync                      | true                                                                                                                                                                       | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                          | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                       | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                         | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.8.228.1:39901
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.8.228.2:46155
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.8.228.3:42689

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 3aaef4faed6d42e6b0f053a5a7aa9422 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689): RUNNING
  5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1:39901): RUNNING
  d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155): RUNNING [LEADER]
All reported replicas are:
  A = 4128644a40f7431b807c3e637d231ee5
  B = 5e47c4c2405947ccb3fc2f33a36d434f
  C = d4a22206472644538d5a4344421fdfeb
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B   C*   |              |              | Yes
 A             | A   B   C    | 2            | -1           | Yes
 B             | A   B   C    | 2            | -1           | Yes
 C             | A   B   C*   | 2            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:02:50.047278  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:02:50.242964 13847 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.243366 13376 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.244800 13606 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 804da5cd702c4474a142cc0c791a45e0 | 127.8.228.62:38583 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                     Value                                                                                      |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                           | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                              | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                           | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                           | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                             | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                            | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4128644a40f7431b807c3e637d231ee5 | 127.8.228.3:42689 | HEALTHY | <none>   |       0        |       0
 5e47c4c2405947ccb3fc2f33a36d434f | 127.8.228.1:39901 | HEALTHY | <none>   |       0        |       0
 d4a22206472644538d5a4344421fdfeb | 127.8.228.2:46155 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                   Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                        | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.8.228.1                                                                                                                                                                | experimental    | 127.8.228.1:39901
 local_ip_for_outbound_sockets    | 127.8.228.2                                                                                                                                                                | experimental    | 127.8.228.2:46155
 local_ip_for_outbound_sockets    | 127.8.228.3                                                                                                                                                                | experimental    | 127.8.228.3:42689
 never_fsync                      | true                                                                                                                                                                       | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                          | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                       | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                         | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.8.228.1:39901
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.8.228.2:46155
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.8.228.3:42689

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 3aaef4faed6d42e6b0f053a5a7aa9422 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689): RUNNING
  5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1:39901): RUNNING
  d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155): RUNNING [LEADER]
All reported replicas are:
  A = 4128644a40f7431b807c3e637d231ee5
  B = 5e47c4c2405947ccb3fc2f33a36d434f
  C = d4a22206472644538d5a4344421fdfeb
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B   C*   |              |              | Yes
 A             | A   B   C    | 2            | -1           | Yes
 B             | A   B   C    | 2            | -1           | Yes
 C             | A   B   C*   | 2            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:02:50.266796  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:02:50.535701 13376 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.536309 13847 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.536504 13606 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 804da5cd702c4474a142cc0c791a45e0 | 127.8.228.62:38583 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                     Value                                                                                      |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                           | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                              | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                           | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                           | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                             | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                            | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4128644a40f7431b807c3e637d231ee5 | 127.8.228.3:42689 | HEALTHY | <none>   |       0        |       0
 5e47c4c2405947ccb3fc2f33a36d434f | 127.8.228.1:39901 | HEALTHY | <none>   |       0        |       0
 d4a22206472644538d5a4344421fdfeb | 127.8.228.2:46155 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                   Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                        | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.8.228.1                                                                                                                                                                | experimental    | 127.8.228.1:39901
 local_ip_for_outbound_sockets    | 127.8.228.2                                                                                                                                                                | experimental    | 127.8.228.2:46155
 local_ip_for_outbound_sockets    | 127.8.228.3                                                                                                                                                                | experimental    | 127.8.228.3:42689
 never_fsync                      | true                                                                                                                                                                       | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                          | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                       | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                         | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.8.228.1:39901
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.8.228.2:46155
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.8.228.3:42689

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 3aaef4faed6d42e6b0f053a5a7aa9422 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  4128644a40f7431b807c3e637d231ee5 (127.8.228.3:42689): RUNNING
  5e47c4c2405947ccb3fc2f33a36d434f (127.8.228.1:39901): RUNNING
  d4a22206472644538d5a4344421fdfeb (127.8.228.2:46155): RUNNING [LEADER]
All reported replicas are:
  A = 4128644a40f7431b807c3e637d231ee5
  B = 5e47c4c2405947ccb3fc2f33a36d434f
  C = d4a22206472644538d5a4344421fdfeb
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B   C*   |              |              | Yes
 A             | A   B   C    | 2            | -1           | Yes
 B             | A   B   C    | 2            | -1           | Yes
 C             | A   B   C*   | 2            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:02:50.558120  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:02:50.577826 13409 raft_consensus.cc:1275] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 5e47c4c2405947ccb3fc2f33a36d434f [term 2 FOLLOWER]: Refusing update from remote peer d4a22206472644538d5a4344421fdfeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2486. Preceding OpId from leader: term: 2 index: 2487. (index mismatch)
I20260812 08:02:50.578398 14300 consensus_queue.cc:1048] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e47c4c2405947ccb3fc2f33a36d434f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 39901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2487, Last known committed idx: 2486, Time since last communication: 0.000s
I20260812 08:02:50.581393 13882 raft_consensus.cc:1275] T 3aaef4faed6d42e6b0f053a5a7aa9422 P 4128644a40f7431b807c3e637d231ee5 [term 2 FOLLOWER]: Refusing update from remote peer d4a22206472644538d5a4344421fdfeb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2486. Preceding OpId from leader: term: 2 index: 2487. (index mismatch)
I20260812 08:02:50.581928 14300 consensus_queue.cc:1048] T 3aaef4faed6d42e6b0f053a5a7aa9422 P d4a22206472644538d5a4344421fdfeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4128644a40f7431b807c3e637d231ee5" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2487, Last known committed idx: 2486, Time since last communication: 0.000s
I20260812 08:02:50.938664 13847 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.938963 13376 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:50.939996 13606 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 804da5cd702c4474a142cc0c791a45e0 | 127.8.228.62:38583 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                     Value                                                                                      |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                            | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                           | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                              | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                           | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                           | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                             | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                            | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4128644a40f7431b807c3e637d231ee5 | 127.8.228.3:42689 | HEALTHY | <none>   |       0        |       0
 5e47c4c2405947ccb3fc2f33a36d434f | 127.8.228.1:39901 | HEALTHY | <none>   |       0        |       0
 d4a22206472644538d5a4344421fdfeb | 127.8.228.2:46155 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                   Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                      | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                        | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.8.228.1                                                                                                                                                                | experimental    | 127.8.228.1:39901
 local_ip_for_outbound_sockets    | 127.8.228.2                                                                                                                                                                | experimental    | 127.8.228.2:46155
 local_ip_for_outbound_sockets    | 127.8.228.3                                                                                                                                                                | experimental    | 127.8.228.3:42689
 never_fsync                      | true                                                                                                                                                                       | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                          | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                       | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                         | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.8.228.1:39901
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.8.228.2:46155
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.8.228.3:42689

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:41335 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:02:50.962173  9104 log_verifier.cc:126] Checking tablet 3aaef4faed6d42e6b0f053a5a7aa9422
I20260812 08:02:51.406999  9104 log_verifier.cc:177] Verified matching terms for 2487 ops in tablet 3aaef4faed6d42e6b0f053a5a7aa9422
I20260812 08:02:51.569885  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 13273
I20260812 08:02:51.584971  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 13503
I20260812 08:02:51.594702  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 13739
I20260812 08:02:51.606606  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 13104
2026-08-12T08:02:51Z chronyd exiting
[       OK ] TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate (18979 ms)
[----------] 4 tests from TabletCopyITest (54927 ms total)

[----------] 1 test from FaultFlags/BadTabletCopyITest
[ RUN      ] FaultFlags/BadTabletCopyITest.TestBadCopy/1
2026-08-12T08:02:51Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:51Z Disabled control of system clock
I20260812 08:02:51.647873  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--webserver_interface=127.8.228.62
--webserver_port=0
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000 with env {}
W20260812 08:02:51.744388 14360 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:51.744546 14360 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:51.744582 14360 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:51.747711 14360 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:51.747761 14360 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:51.747779 14360 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:51.747799 14360 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:51.751421 14360 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:51.752169 14360 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:51.753044 14360 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:51.757788 14370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:51.757884 14368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:51.757843 14374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:51.757992 14360 server_base.cc:1061] running on GCE node
I20260812 08:02:51.758451 14360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:51.759203 14360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:51.760357 14360 hybrid_clock.cc:648] HybridClock initialized: now 1786521771760342 us; error 29 us; skew 500 ppm
I20260812 08:02:51.761866 14360 webserver.cc:533] Webserver started at http://127.8.228.62:41681/ using document root <none> and password file <none>
I20260812 08:02:51.762385 14360 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:51.762439 14360 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:51.762614 14360 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:51.763901 14360 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/instance:
uuid: "12e3751703744ce7a01d6b70ca4ac8f0"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:51.764324 14360 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal/instance:
uuid: "12e3751703744ce7a01d6b70ca4ac8f0"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:51.767192 14360 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260812 08:02:51.769038 14393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:51.769855 14360 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:51.769958 14360 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "12e3751703744ce7a01d6b70ca4ac8f0"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:51.770033 14360 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:51.790727 14360 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:51.791227 14360 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:51.791371 14360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:51.797783 14481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:35979 every 8 connection(s)
I20260812 08:02:51.797781 14360 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:35979
I20260812 08:02:51.798682 14360 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:51.801158 14484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:51.802166  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 14360
I20260812 08:02:51.802269  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal/instance
I20260812 08:02:51.805820 14484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap starting.
I20260812 08:02:51.807704 14484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:51.808422 14484 log.cc:826] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:51.809914 14484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: No bootstrap required, opened a new log
I20260812 08:02:51.812343 14484 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:51.812493 14484 raft_consensus.cc:385] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:51.812531 14484 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Initialized, Role: FOLLOWER
I20260812 08:02:51.812832 14484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:51.812927 14484 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:51.812965 14484 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:51.813035 14484 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:51.813666 14484 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:51.813923 14484 leader_election.cc:304] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12e3751703744ce7a01d6b70ca4ac8f0; no voters: 
I20260812 08:02:51.814131 14484 leader_election.cc:290] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:51.814224 14491 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:51.814421 14491 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 LEADER]: Becoming Leader. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Running, Role: LEADER
I20260812 08:02:51.814718 14491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:51.815037 14484 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:51.816075 14492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:02:51.816097 14493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12e3751703744ce7a01d6b70ca4ac8f0. Latest consensus state: current_term: 1 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:02:51.816228 14492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:51.816300 14493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:51.817471 14503 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:51.819671 14503 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:51.824015 14503 catalog_manager.cc:1383] Generated new cluster ID: a38f66dc7a1e4f9cb06b7cf4131f1ad9
I20260812 08:02:51.824066 14503 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:51.849314 14503 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:51.849965 14503 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:51.856124 14503 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Generated new TSK 0
I20260812 08:02:51.856530 14503 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:51.859977  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:0
--local_ip_for_outbound_sockets=127.8.228.1
--webserver_interface=127.8.228.1
--webserver_port=0
--tserver_master_addrs=127.8.228.62:35979
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 08:02:51.958423 14527 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:51.958590 14527 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:51.958644 14527 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 08:02:51.958680 14527 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:51.961831 14527 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:51.961903 14527 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:02:51.961970 14527 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:02:51.965984 14527 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.14527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:51.966885 14527 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:51.967820 14527 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:51.973145 14547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:51.973155 14536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:51.973340 14527 server_base.cc:1061] running on GCE node
W20260812 08:02:51.973196 14539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:51.973860 14527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:51.974306 14527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:51.975478 14527 hybrid_clock.cc:648] HybridClock initialized: now 1786521771975464 us; error 32 us; skew 500 ppm
I20260812 08:02:51.976948 14527 webserver.cc:533] Webserver started at http://127.8.228.1:39159/ using document root <none> and password file <none>
I20260812 08:02:51.977425 14527 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:51.977473 14527 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:51.977618 14527 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:51.978957 14527 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/instance:
uuid: "cc83802806d14ecba59903d3d4d6bf7f"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:51.979370 14527 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance:
uuid: "cc83802806d14ecba59903d3d4d6bf7f"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:51.982231 14527 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:51.984143 14558 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:51.984978 14527 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:51.985065 14527 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "cc83802806d14ecba59903d3d4d6bf7f"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:51.985128 14527 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:52.004603 14527 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:52.005100 14527 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:52.005244 14527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:52.005702 14527 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:52.006574 14527 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:52.006623 14527 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.006670 14527 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:52.006698 14527 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.014775 14527 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:34007
I20260812 08:02:52.014839 14774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:34007 every 8 connection(s)
I20260812 08:02:52.015556 14527 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:52.016343  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 14527
I20260812 08:02:52.016464  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:52.018661  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:0
--local_ip_for_outbound_sockets=127.8.228.2
--webserver_interface=127.8.228.2
--webserver_port=0
--tserver_master_addrs=127.8.228.62:35979
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
I20260812 08:02:52.023420 14775 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:52.023613 14775 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:52.024034 14775 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:52.025511 14420 ts_manager.cc:194] Registered new tserver with Master: cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:02:52.027045 14420 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:50739
W20260812 08:02:52.117722 14779 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:52.117882 14779 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:52.117920 14779 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 08:02:52.117946 14779 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:52.121044 14779 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:52.121124 14779 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:02:52.121178 14779 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:02:52.124739 14779 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.14779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:52.125530 14779 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:52.126438 14779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:52.131855 14787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:52.131827 14786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:52.131903 14779 server_base.cc:1061] running on GCE node
W20260812 08:02:52.131832 14789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:52.132335 14779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:52.132768 14779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:52.133913 14779 hybrid_clock.cc:648] HybridClock initialized: now 1786521772133896 us; error 27 us; skew 500 ppm
I20260812 08:02:52.135412 14779 webserver.cc:533] Webserver started at http://127.8.228.2:33001/ using document root <none> and password file <none>
I20260812 08:02:52.135857 14779 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:52.135905 14779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:52.136044 14779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:52.137312 14779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/instance:
uuid: "f492a4e4cbba4f93a706a4048833cbd6"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.137702 14779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance:
uuid: "f492a4e4cbba4f93a706a4048833cbd6"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.140486 14779 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260812 08:02:52.142267 14803 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.143123 14779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 08:02:52.143208 14779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "f492a4e4cbba4f93a706a4048833cbd6"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.143271 14779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:52.169482 14779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:52.169935 14779 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:52.170055 14779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:52.170509 14779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:52.171306 14779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:52.171350 14779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.171383 14779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:52.171403 14779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.179561 14779 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:45805
I20260812 08:02:52.179586 15006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:45805 every 8 connection(s)
I20260812 08:02:52.180315 14779 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:52.185748  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 14779
I20260812 08:02:52.185858  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:52.187206 15009 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:52.187397 15009 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:52.187873 15009 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:52.188234  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.3:0
--local_ip_for_outbound_sockets=127.8.228.3
--webserver_interface=127.8.228.3
--webserver_port=0
--tserver_master_addrs=127.8.228.62:35979
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
I20260812 08:02:52.188827 14419 ts_manager.cc:194] Registered new tserver with Master: f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:02:52.189373 14419 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:41917
W20260812 08:02:52.285606 15015 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:52.285766 15015 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:52.285808 15015 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 08:02:52.285843 15015 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:52.289069 15015 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:52.289135 15015 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:02:52.289211 15015 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.3
I20260812 08:02:52.292840 15015 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.228.3
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.15015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:52.293697 15015 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:52.294627 15015 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:52.300006 15029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:52.300012 15025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:52.300074 15026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:52.300216 15015 server_base.cc:1061] running on GCE node
I20260812 08:02:52.300563 15015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:52.301041 15015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:52.302168 15015 hybrid_clock.cc:648] HybridClock initialized: now 1786521772302150 us; error 28 us; skew 500 ppm
I20260812 08:02:52.303628 15015 webserver.cc:533] Webserver started at http://127.8.228.3:44331/ using document root <none> and password file <none>
I20260812 08:02:52.304076 15015 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:52.304136 15015 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:52.304272 15015 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:52.305545 15015 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/instance:
uuid: "38605eeb040245c58a065d2ae5811a90"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.305922 15015 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance:
uuid: "38605eeb040245c58a065d2ae5811a90"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.308830 15015 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:52.310743 15039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.311645 15015 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:52.311736 15015 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
uuid: "38605eeb040245c58a065d2ae5811a90"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.311820 15015 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:52.353350 15015 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:52.353873 15015 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:52.354004 15015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:52.354494 15015 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:52.355372 15015 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:52.355418 15015 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.355458 15015 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:52.355505 15015 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.363776 15015 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.3:43175
I20260812 08:02:52.363838 15244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.3:43175 every 8 connection(s)
I20260812 08:02:52.364584 15015 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:52.371778 15246 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:52.371977 15246 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:52.372430 15246 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:52.373409 14419 ts_manager.cc:194] Registered new tserver with Master: 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:02:52.373914 14419 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.3:53859
I20260812 08:02:52.374504  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 15015
I20260812 08:02:52.374601  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:52.376559  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.4:0
--local_ip_for_outbound_sockets=127.8.228.4
--webserver_interface=127.8.228.4
--webserver_port=0
--tserver_master_addrs=127.8.228.62:35979
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 08:02:52.474272 15251 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:52.474448 15251 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:52.474494 15251 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 08:02:52.474529 15251 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:52.477725 15251 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:52.477792 15251 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:02:52.477867 15251 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.4
I20260812 08:02:52.481473 15251 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.8.228.4
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.15251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:52.482283 15251 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:52.483215 15251 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:52.488991 15259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:52.489001 15260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:52.489095 15251 server_base.cc:1061] running on GCE node
W20260812 08:02:52.489034 15265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:52.489557 15251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:52.489982 15251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:52.491127 15251 hybrid_clock.cc:648] HybridClock initialized: now 1786521772491113 us; error 27 us; skew 500 ppm
I20260812 08:02:52.492874 15251 webserver.cc:533] Webserver started at http://127.8.228.4:37399/ using document root <none> and password file <none>
I20260812 08:02:52.493353 15251 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:52.493405 15251 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:52.493572 15251 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:52.494936 15251 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/instance:
uuid: "e148dcbee1fe4d96bab45f72a90418a4"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.495350 15251 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal/instance:
uuid: "e148dcbee1fe4d96bab45f72a90418a4"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.498147 15251 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:52.500030 15275 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.500844 15251 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:02:52.500941 15251 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
uuid: "e148dcbee1fe4d96bab45f72a90418a4"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:52.501015 15251 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:52.510121 15251 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:52.510651 15251 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:52.510810 15251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:52.511277 15251 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:52.512094 15251 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:52.512141 15251 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.512188 15251 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:52.512228 15251 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.520476 15251 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.4:44691
I20260812 08:02:52.520527 15472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.4:44691 every 8 connection(s)
I20260812 08:02:52.521260 15251 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
I20260812 08:02:52.522091  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 15251
I20260812 08:02:52.522193  9104 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal/instance
I20260812 08:02:52.528102 15475 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:52.528277 15475 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:52.528650 15475 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:52.529469 14419 ts_manager.cc:194] Registered new tserver with Master: e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691)
I20260812 08:02:52.529955 14419 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.4:54445
I20260812 08:02:52.535928  9104 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 08:02:52.542934  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 15251
I20260812 08:02:52.555138  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 14360
I20260812 08:02:52.567276  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--webserver_interface=127.8.228.62
--webserver_port=41681
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000 with env {}
W20260812 08:02:52.667903 15491 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:52.668073 15491 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:52.668138 15491 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:52.671275 15491 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:52.671327 15491 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:52.671353 15491 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:52.671383 15491 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:52.675051 15491 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=41681
--never_fsync=true
--heap_profile_path=/tmp/kudu.15491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:52.675846 15491 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:52.676748 15491 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:52.681275 15510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:52.681272 15501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:52.681285 15500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:52.681540 15491 server_base.cc:1061] running on GCE node
I20260812 08:02:52.682005 15491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:52.682796 15491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:52.683939 15491 hybrid_clock.cc:648] HybridClock initialized: now 1786521772683920 us; error 34 us; skew 500 ppm
I20260812 08:02:52.685353 15491 webserver.cc:533] Webserver started at http://127.8.228.62:41681/ using document root <none> and password file <none>
I20260812 08:02:52.685827 15491 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:52.685896 15491 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:52.688817 15491 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:52.690521 15518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:52.691401 15491 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:52.691495 15491 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "12e3751703744ce7a01d6b70ca4ac8f0"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:52.691804 15491 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:52.714984 15491 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:52.715498 15491 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:52.715648 15491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:52.722043 15491 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:35979
I20260812 08:02:52.722048 15598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:35979 every 8 connection(s)
I20260812 08:02:52.722968 15491 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:52.726431 15600 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:02:52.727733 15600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap starting.
I20260812 08:02:52.732725  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 15491
I20260812 08:02:52.742729 15600 log.cc:826] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:52.748551 15600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:52.748860 15600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap complete.
I20260812 08:02:52.751787 15600 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:52.752063 15600 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Initialized, Role: FOLLOWER
I20260812 08:02:52.752461 15600 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:52.752575 15600 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:52.752635 15600 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:52.752746 15600 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:52.754052 15600 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:52.754356 15600 leader_election.cc:304] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12e3751703744ce7a01d6b70ca4ac8f0; no voters: 
I20260812 08:02:52.754614 15600 leader_election.cc:290] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 08:02:52.754719 15606 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:52.754915 15606 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 LEADER]: Becoming Leader. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Running, Role: LEADER
I20260812 08:02:52.755229 15606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:52.755539 15600 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:52.755952 15609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12e3751703744ce7a01d6b70ca4ac8f0. Latest consensus state: current_term: 2 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:02:52.756057 15609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:52.756300 15608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:02:52.756402 15608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:52.756459 15612 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:52.758906 15612 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:52.759588 15612 catalog_manager.cc:1295] Loaded cluster ID: a38f66dc7a1e4f9cb06b7cf4131f1ad9
I20260812 08:02:52.759637 15612 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:52.761042 15612 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:52.761584 15612 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Loaded TSK: 0
I20260812 08:02:52.762323 15612 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:53.028893 14775 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:02:53.033064 15546 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" instance_seqno: 1786521772012664) as {username='slave'} at 127.8.228.1:47625; Asking this server to re-register.
I20260812 08:02:53.033589 14775 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:53.033754 14775 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:53.034664 15546 ts_manager.cc:194] Registered new tserver with Master: cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:02:53.191179 15009 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:02:53.194654 15546 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" instance_seqno: 1786521772177445) as {username='slave'} at 127.8.228.2:40275; Asking this server to re-register.
I20260812 08:02:53.195123 15009 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:53.195297 15009 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:53.195957 15546 ts_manager.cc:194] Registered new tserver with Master: f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:02:53.375742 15246 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:02:53.379550 15546 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "38605eeb040245c58a065d2ae5811a90" instance_seqno: 1786521772361604) as {username='slave'} at 127.8.228.3:33131; Asking this server to re-register.
I20260812 08:02:53.379964 15246 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:53.380125 15246 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:53.380685 15546 ts_manager.cc:194] Registered new tserver with Master: 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:02:53.412650 15546 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43020:
name: "table_a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:53.413897 15546 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table table_a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:53.428929 15126 tablet_service.cc:1511] Processing CreateTablet for tablet a6a1bb938f084feda86bec0572064f40 (DEFAULT_TABLE table=table_a [id=bcdf38cbb8b44f78851861b7d36b8506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:53.429459 14885 tablet_service.cc:1511] Processing CreateTablet for tablet a6a1bb938f084feda86bec0572064f40 (DEFAULT_TABLE table=table_a [id=bcdf38cbb8b44f78851861b7d36b8506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:53.429447 14652 tablet_service.cc:1511] Processing CreateTablet for tablet a6a1bb938f084feda86bec0572064f40 (DEFAULT_TABLE table=table_a [id=bcdf38cbb8b44f78851861b7d36b8506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:53.429906 15126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a1bb938f084feda86bec0572064f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:53.430325 14652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a1bb938f084feda86bec0572064f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:53.430325 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a1bb938f084feda86bec0572064f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:53.434530 15668 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Bootstrap starting.
I20260812 08:02:53.435454 15670 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap starting.
I20260812 08:02:53.436175 15671 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap starting.
I20260812 08:02:53.436864 15668 tablet_bootstrap.cc:654] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:53.437436 15670 tablet_bootstrap.cc:654] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:53.437737 15671 tablet_bootstrap.cc:654] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:53.437714 15668 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:53.438207 15670 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:53.438531 15671 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:53.439874 15671 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: No bootstrap required, opened a new log
I20260812 08:02:53.439891 15668 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: No bootstrap required, opened a new log
I20260812 08:02:53.439917 15670 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: No bootstrap required, opened a new log
I20260812 08:02:53.440042 15671 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:02:53.440053 15670 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:53.440054 15668 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:53.442180 15671 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.442359 15671 raft_consensus.cc:385] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:53.442451 15671 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Initialized, Role: FOLLOWER
I20260812 08:02:53.442827 15671 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.442946 15670 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.442943 15668 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.443194 15668 raft_consensus.cc:385] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:53.443185 15670 raft_consensus.cc:385] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:53.443253 15670 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc83802806d14ecba59903d3d4d6bf7f, State: Initialized, Role: FOLLOWER
I20260812 08:02:53.443293 15668 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38605eeb040245c58a065d2ae5811a90, State: Initialized, Role: FOLLOWER
I20260812 08:02:53.443711 15668 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.443877 15671 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 08:02:53.444298 15670 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.444519 15668 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:53.445070 15670 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260812 08:02:53.449925 15012 tablet.cc:2406] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:53.449957 15247 tablet.cc:2406] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:53.453328 14776 tablet.cc:2406] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:53.662166 15676 raft_consensus.cc:493] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:53.662379 15676 raft_consensus.cc:515] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.663460 15676 leader_election.cc:290] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175), cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:02:53.667436 15160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90" is_pre_election: true
I20260812 08:02:53.667688 15160 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 0.
I20260812 08:02:53.667984 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc83802806d14ecba59903d3d4d6bf7f" is_pre_election: true
I20260812 08:02:53.668149 14804 leader_election.cc:304] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:02:53.668258 14682 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 0.
I20260812 08:02:53.668424 15676 raft_consensus.cc:2804] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:53.668489 15676 raft_consensus.cc:493] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:53.668534 15676 raft_consensus.cc:3060] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:53.669376 15676 raft_consensus.cc:515] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.669700 15676 leader_election.cc:290] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 1 election: Requested vote from peers 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175), cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:02:53.670030 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc83802806d14ecba59903d3d4d6bf7f"
I20260812 08:02:53.670029 15160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90"
I20260812 08:02:53.670149 15160 raft_consensus.cc:3060] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:53.670159 14682 raft_consensus.cc:3060] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:53.671211 14682 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 1.
I20260812 08:02:53.671211 15160 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 1.
I20260812 08:02:53.671510 14808 leader_election.cc:304] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc83802806d14ecba59903d3d4d6bf7f, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:02:53.671744 15676 raft_consensus.cc:2804] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:53.671937 15676 raft_consensus.cc:697] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 LEADER]: Becoming Leader. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Running, Role: LEADER
I20260812 08:02:53.672250 15676 consensus_queue.cc:237] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:53.675094 15545 catalog_manager.cc:5719] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2). New cstate: current_term: 1 leader_uuid: "f492a4e4cbba4f93a706a4048833cbd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:53.707525  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.4:44691
--local_ip_for_outbound_sockets=127.8.228.4
--tserver_master_addrs=127.8.228.62:35979
--webserver_port=37399
--webserver_interface=127.8.228.4
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 08:02:53.808346 15686 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:53.808513 15686 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:53.808553 15686 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 08:02:53.808571 15686 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:53.811729 15686 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:53.811796 15686 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:02:53.811851 15686 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.4
I20260812 08:02:53.815507 15686 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.4:44691
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.8.228.4
--webserver_port=37399
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.15686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:53.816321 15686 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:53.817337 15686 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:53.822810 15691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:53.822824 15695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:53.822908 15692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:53.823257 15686 server_base.cc:1061] running on GCE node
I20260812 08:02:53.823539 15686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:53.823988 15686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:53.825132 15686 hybrid_clock.cc:648] HybridClock initialized: now 1786521773825121 us; error 30 us; skew 500 ppm
I20260812 08:02:53.826776 15686 webserver.cc:533] Webserver started at http://127.8.228.4:37399/ using document root <none> and password file <none>
I20260812 08:02:53.827306 15686 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:53.827373 15686 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:53.830303 15686 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:53.832000 15704 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:53.832917 15686 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:02:53.833016 15686 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
uuid: "e148dcbee1fe4d96bab45f72a90418a4"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:02:53.833346 15686 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:53.856081 15686 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:53.856587 15686 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:53.856746 15686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:53.857247 15686 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:53.858150 15686 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:53.858197 15686 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:53.858245 15686 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:53.858273 15686 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:53.866571 15686 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.4:44691
I20260812 08:02:53.866619 15924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.4:44691 every 8 connection(s)
I20260812 08:02:53.867424 15686 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
I20260812 08:02:53.873934  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 15686
I20260812 08:02:53.874284 15925 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:53.874526 15925 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:53.874976 15925 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:53.875954 15545 ts_manager.cc:194] Registered new tserver with Master: e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691)
I20260812 08:02:53.876812 15545 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.4:59437
I20260812 08:02:53.898762  9104 tablet_copy-itest.cc:1499] Blocks diff: 0
I20260812 08:02:53.922569 14682 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:53.922648 15160 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:53.923252 15682 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:53.923655 15676 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:53.930977 15948 mvcc.cc:204] Tried to move back new op lower bound from 7317593185980227584 to 7317593184964091904. Current Snapshot: MvccSnapshot[applied={T|T < 7317593185980227584}]
I20260812 08:02:53.939561 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:53.939563 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:53.941924 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:53.989598 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.044s	user 0.018s	sys 0.000s Metrics: {"bytes_written":9878,"cfile_init":1,"compiler_manager_pool.queue_time_us":36232,"dirs.queue_time_us":18120,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":510,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"thread_start_us":130,"threads_started":2}
I20260812 08:02:53.990677 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:53.994446 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.055s	user 0.020s	sys 0.000s Metrics: {"bytes_written":9878,"cfile_init":1,"drs_written":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3220,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":200,"spinlock_wait_cycles":192256,"thread_start_us":126,"threads_started":2}
I20260812 08:02:53.995369 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.066509 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.076s	user 0.012s	sys 0.001s Metrics: {"bytes_written":11242,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":794,"drs_written":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4,"lbm_write_time_us":540,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":250,"spinlock_wait_cycles":8793344}
I20260812 08:02:54.067533 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013733
I20260812 08:02:54.090911 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.095s	user 0.015s	sys 0.000s Metrics: {"bytes_written":15096,"cfile_init":1,"dirs.queue_time_us":1811,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":772,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":537,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":400}
I20260812 08:02:54.091802 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013456
I20260812 08:02:54.138147 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.070s	user 0.020s	sys 0.000s Metrics: {"bytes_written":16419,"cfile_cache_hit":10,"cfile_cache_hit_bytes":8425,"cfile_cache_miss":26,"cfile_cache_miss_bytes":24107,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":828,"drs_written":1,"lbm_read_time_us":694,"lbm_reads_lt_1ms":54,"lbm_write_time_us":528,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":450,"thread_start_us":312,"threads_started":5}
I20260812 08:02:54.145577 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.205s	user 0.022s	sys 0.000s Metrics: {"bytes_written":9878,"cfile_init":1,"compiler_manager_pool.queue_time_us":18389,"dirs.queue_time_us":72423,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":16368,"drs_written":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6383,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":200,"thread_start_us":196,"threads_started":2}
I20260812 08:02:54.146317 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.146854 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.173517 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.081s	user 0.023s	sys 0.000s Metrics: {"bytes_written":20248,"cfile_cache_hit":10,"cfile_cache_hit_bytes":11161,"cfile_cache_miss":26,"cfile_cache_miss_bytes":31591,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":663,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":981,"drs_written":1,"lbm_read_time_us":714,"lbm_reads_lt_1ms":54,"lbm_write_time_us":4932,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":600,"thread_start_us":328,"threads_started":5}
I20260812 08:02:54.174453 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.238157 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.062s	user 0.025s	sys 0.005s Metrics: {"bytes_written":33182,"cfile_init":1,"dirs.queue_time_us":2868,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":881,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":546,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 08:02:54.238796 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013708
I20260812 08:02:54.302644 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.156s	user 0.030s	sys 0.000s Metrics: {"bytes_written":33146,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":165,"dirs.run_wall_time_us":3070,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":575,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 08:02:54.303269 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013305
I20260812 08:02:54.332931 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.177s	user 0.037s	sys 0.000s Metrics: {"bytes_written":40881,"cfile_init":1,"dirs.queue_time_us":102,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":2636,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1164,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1400}
I20260812 08:02:54.339154 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 13935 bytes on disk
I20260812 08:02:54.342698 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.003s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":124,"lbm_reads_lt_1ms":8}
I20260812 08:02:54.343248 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.011798
I20260812 08:02:54.359822 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.120s	user 0.033s	sys 0.005s Metrics: {"bytes_written":48573,"cfile_cache_hit":10,"cfile_cache_hit_bytes":31237,"cfile_cache_miss":26,"cfile_cache_miss_bytes":87333,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1219,"dirs.run_cpu_time_us":361,"dirs.run_wall_time_us":2047,"drs_written":1,"lbm_read_time_us":725,"lbm_reads_lt_1ms":54,"lbm_write_time_us":579,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1700}
I20260812 08:02:54.360618 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 14719 bytes on disk
I20260812 08:02:54.362932 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.373664 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.397650 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.054s	user 0.036s	sys 0.000s Metrics: {"bytes_written":46076,"cfile_cache_hit":10,"cfile_cache_hit_bytes":29411,"cfile_cache_miss":26,"cfile_cache_miss_bytes":81933,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":939,"drs_written":1,"lbm_read_time_us":690,"lbm_reads_lt_1ms":46,"lbm_write_time_us":566,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1600}
I20260812 08:02:54.398089 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 13843 bytes on disk
I20260812 08:02:54.398429 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.398763 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.425658 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.116s	user 0.027s	sys 0.008s Metrics: {"bytes_written":44648,"cfile_cache_hit":10,"cfile_cache_hit_bytes":28502,"cfile_cache_miss":26,"cfile_cache_miss_bytes":79700,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":4203,"dirs.run_cpu_time_us":343,"dirs.run_wall_time_us":4321,"drs_written":1,"lbm_read_time_us":1455,"lbm_reads_lt_1ms":54,"lbm_write_time_us":552,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1550}
I20260812 08:02:54.426367 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 13434 bytes on disk
I20260812 08:02:54.426872 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.427240 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.442211 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.068s	user 0.024s	sys 0.001s Metrics: {"bytes_written":29347,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":776,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":533,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":950}
I20260812 08:02:54.442651 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013381
I20260812 08:02:54.496884 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.098s	user 0.028s	sys 0.000s Metrics: {"bytes_written":35759,"cfile_init":1,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":723,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":556,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1200}
I20260812 08:02:54.497424 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 10404 bytes on disk
I20260812 08:02:54.498992 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.499423 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014130
I20260812 08:02:54.592015 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.165s	user 0.032s	sys 0.002s Metrics: {"bytes_written":39577,"cfile_init":1,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":151,"dirs.run_wall_time_us":967,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":590,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1350}
I20260812 08:02:54.592617 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 11694 bytes on disk
I20260812 08:02:54.593010 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.593446 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014197
I20260812 08:02:54.596127 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.097s	user 0.053s	sys 0.002s Metrics: {"bytes_written":81009,"cfile_cache_hit":10,"cfile_cache_hit_bytes":51312,"cfile_cache_miss":26,"cfile_cache_miss_bytes":142804,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":149,"dirs.run_wall_time_us":834,"drs_written":1,"lbm_read_time_us":677,"lbm_reads_lt_1ms":46,"lbm_write_time_us":749,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2800,"spinlock_wait_cycles":16768}
I20260812 08:02:54.596563 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.631680 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.189s	user 0.047s	sys 0.006s Metrics: {"bytes_written":77008,"cfile_cache_hit":10,"cfile_cache_hit_bytes":48577,"cfile_cache_miss":26,"cfile_cache_miss_bytes":135143,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":888,"drs_written":1,"lbm_read_time_us":570,"lbm_reads_lt_1ms":50,"lbm_write_time_us":6469,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":24,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2650}
I20260812 08:02:54.632190 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.638288 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.032s	user 0.028s	sys 0.002s Metrics: {"bytes_written":43411,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":874,"drs_written":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4,"lbm_write_time_us":537,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1500}
I20260812 08:02:54.638813 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014427
I20260812 08:02:54.722554 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.084s	user 0.082s	sys 0.000s Metrics: {"bytes_written":123840,"cfile_cache_hit":10,"cfile_cache_hit_bytes":78710,"cfile_cache_miss":28,"cfile_cache_miss_bytes":219376,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":193,"dirs.run_cpu_time_us":143,"dirs.run_wall_time_us":963,"drs_written":1,"lbm_read_time_us":790,"lbm_reads_lt_1ms":56,"lbm_write_time_us":783,"lbm_writes_lt_1ms":26,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":4300}
I20260812 08:02:54.723100 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 38607 bytes on disk
I20260812 08:02:54.723482 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.723779 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.743705 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.020s	user 0.017s	sys 0.000s Metrics: {"bytes_written":25405,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":745,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":472,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800}
I20260812 08:02:54.744225 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014717
I20260812 08:02:54.769408 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.136s	user 0.041s	sys 0.001s Metrics: {"bytes_written":47404,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":836,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":568,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1650}
I20260812 08:02:54.769917 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014445
I20260812 08:02:54.780632 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.187s	user 0.055s	sys 0.003s Metrics: {"bytes_written":83333,"cfile_cache_hit":10,"cfile_cache_hit_bytes":53142,"cfile_cache_miss":26,"cfile_cache_miss_bytes":147516,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":4773,"dirs.run_cpu_time_us":447,"dirs.run_wall_time_us":2996,"drs_written":1,"lbm_read_time_us":641,"lbm_reads_lt_1ms":46,"lbm_write_time_us":1102,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2900,"thread_start_us":101,"threads_started":2}
I20260812 08:02:54.781559 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 25559 bytes on disk
I20260812 08:02:54.781958 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.782279 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.839463 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.095s	user 0.094s	sys 0.000s Metrics: {"bytes_written":145011,"cfile_cache_hit":10,"cfile_cache_hit_bytes":93516,"cfile_cache_miss":28,"cfile_cache_miss_bytes":261606,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":327,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":1057,"drs_written":1,"lbm_read_time_us":779,"lbm_reads_lt_1ms":52,"lbm_write_time_us":889,"lbm_writes_lt_1ms":27,"mutex_wait_us":84,"num_input_rowsets":2,"peak_mem_usage":80576,"rows_written":5100}
I20260812 08:02:54.839954 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 46620 bytes on disk
I20260812 08:02:54.840276 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20260812 08:02:54.840603 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:54.858596 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.018s	user 0.015s	sys 0.000s Metrics: {"bytes_written":19046,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":847,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":464,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":550}
I20260812 08:02:54.859115 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013854
I20260812 08:02:54.879667 15925 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:02:54.904217  9104 tablet_copy-itest.cc:1499] Blocks diff: 10
I20260812 08:02:54.940500 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.158s	user 0.046s	sys 0.004s Metrics: {"bytes_written":71887,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":965,"drs_written":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4,"lbm_write_time_us":621,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":2450}
I20260812 08:02:54.941051 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014779
I20260812 08:02:55.002849 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.233s	user 0.079s	sys 0.007s Metrics: {"bytes_written":123840,"cfile_cache_hit":10,"cfile_cache_hit_bytes":78715,"cfile_cache_miss":28,"cfile_cache_miss_bytes":219505,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":479,"dirs.run_cpu_time_us":393,"dirs.run_wall_time_us":1904,"drs_written":1,"lbm_read_time_us":863,"lbm_reads_lt_1ms":56,"lbm_write_time_us":777,"lbm_writes_lt_1ms":26,"mutex_wait_us":144,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":4300}
I20260812 08:02:55.003799 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 38607 bytes on disk
I20260812 08:02:55.004088 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.143s	user 0.099s	sys 0.004s Metrics: {"bytes_written":163622,"cfile_cache_hit":10,"cfile_cache_hit_bytes":104379,"cfile_cache_miss":30,"cfile_cache_miss_bytes":292113,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":3181,"dirs.run_cpu_time_us":514,"dirs.run_wall_time_us":2484,"drs_written":1,"lbm_read_time_us":883,"lbm_reads_lt_1ms":54,"lbm_write_time_us":866,"lbm_writes_lt_1ms":28,"mutex_wait_us":360,"num_input_rowsets":2,"peak_mem_usage":89214,"rows_written":5650,"spinlock_wait_cycles":17792}
I20260812 08:02:55.004779 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 51818 bytes on disk
I20260812 08:02:55.005205 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.005544 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.006319 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.011734 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.060362 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.055s	user 0.023s	sys 0.000s Metrics: {"bytes_written":31858,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":895,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":522,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1050,"spinlock_wait_cycles":896}
I20260812 08:02:55.060933 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014171
I20260812 08:02:55.160724 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.220s	user 0.097s	sys 0.000s Metrics: {"bytes_written":155693,"cfile_cache_hit":10,"cfile_cache_hit_bytes":97898,"cfile_cache_miss":30,"cfile_cache_miss_bytes":272322,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":2630,"dirs.run_cpu_time_us":552,"dirs.run_wall_time_us":3768,"drs_written":1,"lbm_read_time_us":790,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1108,"lbm_writes_lt_1ms":28,"mutex_wait_us":1774,"num_input_rowsets":2,"peak_mem_usage":82896,"rows_written":5350}
I20260812 08:02:55.161926 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 49019 bytes on disk
I20260812 08:02:55.162310 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.162688 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.172582 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.161s	user 0.055s	sys 0.003s Metrics: {"bytes_written":73160,"cfile_init":1,"compiler_manager_pool.queue_time_us":4431,"compiler_manager_pool.run_cpu_time_us":6,"compiler_manager_pool.run_wall_time_us":7,"dirs.queue_time_us":3525,"dirs.run_cpu_time_us":136,"dirs.run_wall_time_us":774,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":974,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":2500,"spinlock_wait_cycles":384}
I20260812 08:02:55.173128 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 21892 bytes on disk
I20260812 08:02:55.173503 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.173907 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014822
I20260812 08:02:55.235497 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.173s	user 0.121s	sys 0.000s Metrics: {"bytes_written":191479,"cfile_cache_hit":10,"cfile_cache_hit_bytes":124094,"cfile_cache_miss":30,"cfile_cache_miss_bytes":345950,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":245,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":1821,"drs_written":1,"lbm_read_time_us":892,"lbm_reads_lt_1ms":54,"lbm_write_time_us":994,"lbm_writes_lt_1ms":29,"mutex_wait_us":2,"num_input_rowsets":2,"peak_mem_usage":104724,"rows_written":6700,"spinlock_wait_cycles":3968}
I20260812 08:02:55.236191 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.239164 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.076s	user 0.046s	sys 0.001s Metrics: {"bytes_written":68226,"cfile_init":1,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":741,"drs_written":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4,"lbm_write_time_us":680,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2300}
I20260812 08:02:55.242669 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014833
I20260812 08:02:55.279938 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.043s	user 0.026s	sys 0.000s Metrics: {"bytes_written":37146,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":876,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":523,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1250}
I20260812 08:02:55.280429 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014451
I20260812 08:02:55.347172 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.173s	user 0.121s	sys 0.000s Metrics: {"bytes_written":193844,"cfile_cache_hit":10,"cfile_cache_hit_bytes":124564,"cfile_cache_miss":30,"cfile_cache_miss_bytes":347678,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":2594,"dirs.run_cpu_time_us":389,"dirs.run_wall_time_us":2193,"drs_written":1,"lbm_read_time_us":826,"lbm_reads_lt_1ms":50,"lbm_write_time_us":8342,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":27,"mutex_wait_us":1536,"num_input_rowsets":2,"peak_mem_usage":105006,"rows_written":6800,"spinlock_wait_cycles":384}
I20260812 08:02:55.347659 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 62970 bytes on disk
I20260812 08:02:55.348012 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.348371 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.396682 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.154s	user 0.132s	sys 0.002s Metrics: {"bytes_written":220795,"cfile_cache_hit":11,"cfile_cache_hit_bytes":158358,"cfile_cache_miss":29,"cfile_cache_miss_bytes":376288,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1224,"dirs.run_cpu_time_us":482,"dirs.run_wall_time_us":3142,"drs_written":1,"lbm_read_time_us":838,"lbm_reads_lt_1ms":53,"lbm_write_time_us":1035,"lbm_writes_lt_1ms":30,"mutex_wait_us":809,"num_input_rowsets":2,"peak_mem_usage":117971,"rows_written":7650,"thread_start_us":66,"threads_started":1}
I20260812 08:02:55.397511 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.403779 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.055s	user 0.033s	sys 0.000s Metrics: {"bytes_written":44644,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":830,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":520,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1550}
I20260812 08:02:55.404296 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 13362 bytes on disk
I20260812 08:02:55.404645 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.405040 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014462
I20260812 08:02:55.419761 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.022s	user 0.019s	sys 0.000s Metrics: {"bytes_written":28028,"cfile_init":1,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":757,"drs_written":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4,"lbm_write_time_us":464,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":900}
I20260812 08:02:55.420245 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 78698 bytes on disk
I20260812 08:02:55.420655 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":95,"lbm_reads_lt_1ms":8}
I20260812 08:02:55.421028 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013939
I20260812 08:02:55.453552 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.173s	user 0.140s	sys 0.000s Metrics: {"bytes_written":228431,"cfile_cache_hit":10,"cfile_cache_hit_bytes":147977,"cfile_cache_miss":32,"cfile_cache_miss_bytes":411899,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":189,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":779,"drs_written":1,"lbm_read_time_us":993,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1059,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":122308,"rows_written":7950}
I20260812 08:02:55.454515 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.479053 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.024s	user 0.023s	sys 0.000s Metrics: {"bytes_written":31856,"cfile_init":1,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":491,"drs_written":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4,"lbm_write_time_us":514,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1050}
I20260812 08:02:55.479594 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 82929 bytes on disk
I20260812 08:02:55.480077 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":102,"lbm_reads_lt_1ms":8}
I20260812 08:02:55.480508 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013895
I20260812 08:02:55.614643 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.193s	user 0.156s	sys 0.001s Metrics: {"bytes_written":244626,"cfile_cache_hit":10,"cfile_cache_hit_bytes":159877,"cfile_cache_miss":32,"cfile_cache_miss_bytes":444165,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":916,"dirs.run_cpu_time_us":371,"dirs.run_wall_time_us":2055,"drs_written":1,"lbm_read_time_us":825,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1111,"lbm_writes_lt_1ms":30,"mutex_wait_us":726,"num_input_rowsets":2,"peak_mem_usage":133082,"rows_written":8550}
I20260812 08:02:55.615370 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.621891 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.217s	user 0.152s	sys 0.000s Metrics: {"bytes_written":239361,"cfile_cache_hit":10,"cfile_cache_hit_bytes":155377,"cfile_cache_miss":32,"cfile_cache_miss_bytes":431501,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":635,"dirs.run_cpu_time_us":427,"dirs.run_wall_time_us":2618,"drs_written":1,"lbm_read_time_us":1003,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1138,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":127782,"rows_written":8350,"thread_start_us":107,"threads_started":2}
I20260812 08:02:55.622529 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 77548 bytes on disk
I20260812 08:02:55.622993 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.623337 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.653875 14569 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.038s	user 0.024s	sys 0.000s Metrics: {"bytes_written":33113,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":477,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":528,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 08:02:55.654402 14776 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014490
I20260812 08:02:55.654677 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.031s	user 0.028s	sys 0.000s Metrics: {"bytes_written":38292,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":414,"drs_written":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4,"lbm_write_time_us":532,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1300}
I20260812 08:02:55.655119 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 11341 bytes on disk
I20260812 08:02:55.655412 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.655762 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014499
I20260812 08:02:55.683211 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.203s	user 0.161s	sys 0.004s Metrics: {"bytes_written":260603,"cfile_cache_hit":10,"cfile_cache_hit_bytes":168392,"cfile_cache_miss":32,"cfile_cache_miss_bytes":467042,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":5884,"dirs.run_cpu_time_us":515,"dirs.run_wall_time_us":3154,"drs_written":1,"lbm_read_time_us":939,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1209,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":139797,"rows_written":9000}
I20260812 08:02:55.683828 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.710750  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 14527
I20260812 08:02:55.722671 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.038s	user 0.023s	sys 0.000s Metrics: {"bytes_written":31854,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":477,"drs_written":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4,"lbm_write_time_us":479,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1050}
I20260812 08:02:55.723233 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014480
I20260812 08:02:55.729985  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 15491
I20260812 08:02:55.747852  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--webserver_interface=127.8.228.62
--webserver_port=41681
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000 with env {}
I20260812 08:02:55.806635 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.151s	user 0.135s	sys 0.000s Metrics: {"bytes_written":277881,"cfile_cache_hit":10,"cfile_cache_hit_bytes":180652,"cfile_cache_miss":32,"cfile_cache_miss_bytes":501432,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":438,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1023,"drs_written":1,"lbm_read_time_us":836,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1004,"lbm_writes_lt_1ms":32,"mutex_wait_us":1,"num_input_rowsets":2,"peak_mem_usage":149457,"rows_written":9650}
I20260812 08:02:55.807170 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 90278 bytes on disk
I20260812 08:02:55.807498 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.807960 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.818328 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.010s	user 0.009s	sys 0.000s Metrics: {"bytes_written":18999,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":470,"drs_written":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4,"lbm_write_time_us":348,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":550}
I20260812 08:02:55.818856 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 4888 bytes on disk
I20260812 08:02:55.819185 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.819564 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013814
W20260812 08:02:55.882406 15925 heartbeater.cc:646] Failed to heartbeat to 127.8.228.62:35979 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.228.62:35979: connect: Connection refused (error 111)
W20260812 08:02:55.886411 16028 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:55.886641 16028 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:55.886706 16028 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:55.891168 16028 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:55.891239 16028 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:55.891276 16028 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:55.891299 16028 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:55.896651 16028 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=41681
--never_fsync=true
--heap_profile_path=/tmp/kudu.16028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:55.897998 16028 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:55.899421 16028 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:55.905717 16044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:55.905910 16042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:55.905730 16046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:55.906443 16028 server_base.cc:1061] running on GCE node
I20260812 08:02:55.906973 16028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:55.906980 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.182s	user 0.173s	sys 0.000s Metrics: {"bytes_written":288185,"cfile_cache_hit":10,"cfile_cache_hit_bytes":188625,"cfile_cache_miss":34,"cfile_cache_miss_bytes":523651,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":597,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1086,"drs_written":1,"lbm_read_time_us":1097,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1326,"lbm_writes_lt_1ms":32,"mutex_wait_us":129,"num_input_rowsets":2,"peak_mem_usage":154205,"rows_written":10050,"spinlock_wait_cycles":2432}
I20260812 08:02:55.907485 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 94134 bytes on disk
I20260812 08:02:55.907879 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.907989 16028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:55.908248 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:55.909170 16028 hybrid_clock.cc:648] HybridClock initialized: now 1786521775909150 us; error 38 us; skew 500 ppm
I20260812 08:02:55.911224 16028 webserver.cc:533] Webserver started at http://127.8.228.62:41681/ using document root <none> and password file <none>
I20260812 08:02:55.911844 16028 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:55.911911 16028 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:55.914433 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.006s	user 0.006s	sys 0.000s Metrics: {"bytes_written":8587,"cfile_init":1,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":494,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":363,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":150}
I20260812 08:02:55.914847 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.012696
I20260812 08:02:55.916059 16028 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:55.918304 16057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:55.919497 16028 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:55.919608 16028 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "12e3751703744ce7a01d6b70ca4ac8f0"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:55.920055 16028 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 08:02:55.935628 15246 heartbeater.cc:646] Failed to heartbeat to 127.8.228.62:35979 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.228.62:35979: connect: Connection refused (error 111)
W20260812 08:02:55.936456 15009 heartbeater.cc:646] Failed to heartbeat to 127.8.228.62:35979 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.228.62:35979: connect: Connection refused (error 111)
I20260812 08:02:55.941066 16028 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:55.941694 16028 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:55.941859 16028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:55.950826 16028 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:35979
I20260812 08:02:55.950834 16158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:35979 every 8 connection(s)
I20260812 08:02:55.952033 16028 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:55.954905  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 16028
I20260812 08:02:55.956691 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.137s	user 0.130s	sys 0.006s Metrics: {"bytes_written":292054,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192015,"cfile_cache_miss":34,"cfile_cache_miss_bytes":532845,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":935,"drs_written":1,"lbm_read_time_us":766,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1105,"lbm_writes_lt_1ms":32,"mutex_wait_us":27,"num_input_rowsets":2,"peak_mem_usage":158590,"rows_written":10200,"spinlock_wait_cycles":27904}
I20260812 08:02:55.957223 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 95499 bytes on disk
I20260812 08:02:55.957607 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4}
I20260812 08:02:55.959576 16159 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:02:55.962296 16159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap starting.
I20260812 08:02:55.980702 16159 log.cc:826] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:55.989584 16159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:55.989959 16159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap complete.
I20260812 08:02:55.994170 16159 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:55.994608 16159 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Initialized, Role: FOLLOWER
I20260812 08:02:55.995075 16159 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:55.995216 16159 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:55.995283 16159 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:55.995383 16159 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:55.997185 16159 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:55.997546 16159 leader_election.cc:304] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12e3751703744ce7a01d6b70ca4ac8f0; no voters: 
I20260812 08:02:55.997888 16159 leader_election.cc:290] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 3 election: Requested vote from peers 
I20260812 08:02:55.998042 16168 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:02:55.998286 16168 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 LEADER]: Becoming Leader. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Running, Role: LEADER
I20260812 08:02:55.998612 16168 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:02:55.999064 16159 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:56.000177 16172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12e3751703744ce7a01d6b70ca4ac8f0. Latest consensus state: current_term: 3 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:02:56.000177 16170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:02:56.000317 16170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:56.000319 16172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:56.001617 16182 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:56.005431 16182 catalog_manager.cc:679] Loaded metadata for table table_a [id=bcdf38cbb8b44f78851861b7d36b8506]
I20260812 08:02:56.006772 16182 tablet_loader.cc:96] loaded metadata for tablet a6a1bb938f084feda86bec0572064f40 (table table_a [id=bcdf38cbb8b44f78851861b7d36b8506])
I20260812 08:02:56.006956 16182 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:56.007561 16182 catalog_manager.cc:1295] Loaded cluster ID: a38f66dc7a1e4f9cb06b7cf4131f1ad9
I20260812 08:02:56.007655 16182 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:56.009931 16182 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:56.010684 16182 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Loaded TSK: 0
I20260812 08:02:56.011641 16182 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:56.055083 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.140s	user 0.138s	sys 0.000s Metrics: {"bytes_written":292054,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192414,"cfile_cache_miss":34,"cfile_cache_miss_bytes":532946,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":474,"dirs.run_cpu_time_us":206,"dirs.run_wall_time_us":1125,"drs_written":1,"lbm_read_time_us":2701,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":57,"lbm_write_time_us":1155,"lbm_writes_lt_1ms":32,"mutex_wait_us":46,"num_input_rowsets":2,"peak_mem_usage":157481,"rows_written":10200,"spinlock_wait_cycles":9088}
I20260812 08:02:56.055630 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 95499 bytes on disk
I20260812 08:02:56.055951 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4}
W20260812 08:02:56.257332 14808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111)
W20260812 08:02:56.258169 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:56.876233 15009 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:56.877825 16090 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" instance_seqno: 1786521772177445) as {username='slave'} at 127.8.228.2:43273; Asking this server to re-register.
I20260812 08:02:56.878319 15009 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:56.878497 15009 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:56.879547 16090 ts_manager.cc:194] Registered new tserver with Master: f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:02:56.885721 15925 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:56.886274 16090 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" instance_seqno: 1786521773864430) as {username='slave'} at 127.8.228.4:39667; Asking this server to re-register.
I20260812 08:02:56.886646 15925 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:56.886786 15925 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:56.887315 16090 ts_manager.cc:194] Registered new tserver with Master: e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691)
I20260812 08:02:56.939358 15246 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:56.940071 16090 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "38605eeb040245c58a065d2ae5811a90" instance_seqno: 1786521772361604) as {username='slave'} at 127.8.228.3:60813; Asking this server to re-register.
I20260812 08:02:56.940482 15246 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:56.940635 15246 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:56.941344 16090 ts_manager.cc:194] Registered new tserver with Master: 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:02:56.993934 16090 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33378:
name: "table_b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:56.995231 16090 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table table_b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:57.007455 15126 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc68e6a467043928d0404bca8788431 (DEFAULT_TABLE table=table_b [id=1e45fcbd969e4fe0a889aa0d0186f446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:57.007740 15126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc68e6a467043928d0404bca8788431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.009425 16249 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Bootstrap starting.
I20260812 08:02:57.009151 15800 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc68e6a467043928d0404bca8788431 (DEFAULT_TABLE table=table_b [id=1e45fcbd969e4fe0a889aa0d0186f446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:57.010046 15800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc68e6a467043928d0404bca8788431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.010673 16249 tablet_bootstrap.cc:654] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.011183 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc68e6a467043928d0404bca8788431 (DEFAULT_TABLE table=table_b [id=1e45fcbd969e4fe0a889aa0d0186f446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:57.011452 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc68e6a467043928d0404bca8788431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.011644 16249 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: No bootstrap required, opened a new log
I20260812 08:02:57.011704 16249 ts_tablet_manager.cc:1403] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.012081 16249 raft_consensus.cc:359] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.012161 16249 raft_consensus.cc:385] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.012179 16249 raft_consensus.cc:740] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38605eeb040245c58a065d2ae5811a90, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.012301 16249 consensus_queue.cc:260] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.012938 16249 ts_tablet_manager.cc:1434] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:57.013621 16253 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap starting.
I20260812 08:02:57.014807 16253 tablet_bootstrap.cc:654] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.015960 16253 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: No bootstrap required, opened a new log
I20260812 08:02:57.016055 16253 ts_tablet_manager.cc:1403] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.016568 16253 raft_consensus.cc:359] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.016641 16255 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap starting.
I20260812 08:02:57.016682 16253 raft_consensus.cc:385] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.016722 16253 raft_consensus.cc:740] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.016855 16253 consensus_queue.cc:260] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.017107 16253 ts_tablet_manager.cc:1434] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.018586 16255 tablet_bootstrap.cc:654] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.019351 16255 log.cc:826] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:57.020779 16255 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: No bootstrap required, opened a new log
I20260812 08:02:57.020928 16255 ts_tablet_manager.cc:1403] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:02:57.023134 16255 raft_consensus.cc:359] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.023291 16255 raft_consensus.cc:385] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.023329 16255 raft_consensus.cc:740] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e148dcbee1fe4d96bab45f72a90418a4, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.023664 16255 consensus_queue.cc:260] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.024310 16255 ts_tablet_manager.cc:1434] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Time spent starting tablet: real 0.003s	user 0.004s	sys 0.000s
W20260812 08:02:57.024582 15926 tablet.cc:2406] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:57.070609 16259 raft_consensus.cc:493] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:57.070791 16259 raft_consensus.cc:515] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.071867 16259 leader_election.cc:290] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805), 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:02:57.075755 14924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "e148dcbee1fe4d96bab45f72a90418a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f492a4e4cbba4f93a706a4048833cbd6" is_pre_election: true
I20260812 08:02:57.075760 15159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "e148dcbee1fe4d96bab45f72a90418a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90" is_pre_election: true
I20260812 08:02:57.075910 15159 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e148dcbee1fe4d96bab45f72a90418a4 in term 0.
I20260812 08:02:57.075940 14924 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e148dcbee1fe4d96bab45f72a90418a4 in term 0.
I20260812 08:02:57.076303 15706 leader_election.cc:304] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, e148dcbee1fe4d96bab45f72a90418a4, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:02:57.076534 16259 raft_consensus.cc:2804] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:57.076608 16259 raft_consensus.cc:493] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:57.076649 16259 raft_consensus.cc:3060] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.077486 16259 raft_consensus.cc:515] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.077776 16259 leader_election.cc:290] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [CANDIDATE]: Term 1 election: Requested vote from peers f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805), 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:02:57.078121 15159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "e148dcbee1fe4d96bab45f72a90418a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90"
I20260812 08:02:57.078100 14924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "e148dcbee1fe4d96bab45f72a90418a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f492a4e4cbba4f93a706a4048833cbd6"
I20260812 08:02:57.078233 15159 raft_consensus.cc:3060] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.078233 14924 raft_consensus.cc:3060] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.079247 15159 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e148dcbee1fe4d96bab45f72a90418a4 in term 1.
I20260812 08:02:57.079255 14924 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e148dcbee1fe4d96bab45f72a90418a4 in term 1.
I20260812 08:02:57.079530 15706 leader_election.cc:304] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, e148dcbee1fe4d96bab45f72a90418a4; no voters: 
I20260812 08:02:57.079756 16259 raft_consensus.cc:2804] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.079953 16259 raft_consensus.cc:697] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 LEADER]: Becoming Leader. State: Replica: e148dcbee1fe4d96bab45f72a90418a4, State: Running, Role: LEADER
I20260812 08:02:57.080229 16259 consensus_queue.cc:237] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:02:57.082999 16090 catalog_manager.cc:5719] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4). New cstate: current_term: 1 leader_uuid: "e148dcbee1fe4d96bab45f72a90418a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:57.098009  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:34007
--local_ip_for_outbound_sockets=127.8.228.1
--tserver_master_addrs=127.8.228.62:35979
--webserver_port=39159
--webserver_interface=127.8.228.1
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 08:02:57.199779 16267 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:57.199961 16267 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:57.200012 16267 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 08:02:57.200049 16267 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:57.203334 16267 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:57.203405 16267 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:02:57.203480 16267 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:02:57.207194 16267 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:34007
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=39159
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.16267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:57.208053 16267 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:57.209072 16267 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:57.214684 16278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:57.214681 16277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:57.214807 16267 server_base.cc:1061] running on GCE node
W20260812 08:02:57.214871 16282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:57.215184 16267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:57.215656 16267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:57.216799 16267 hybrid_clock.cc:648] HybridClock initialized: now 1786521777216780 us; error 30 us; skew 500 ppm
I20260812 08:02:57.218250 16267 webserver.cc:533] Webserver started at http://127.8.228.1:39159/ using document root <none> and password file <none>
I20260812 08:02:57.218799 16267 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:57.218868 16267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:57.221854 16267 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:57.226810 16294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:57.227584 16267 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.000s
I20260812 08:02:57.227682 16267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "cc83802806d14ecba59903d3d4d6bf7f"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:02:57.228001 16267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 10
Total live bytes: 366812
Total live bytes (after alignment): 389120
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:57.249863 16267 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:57.250615 16267 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:57.250797 16267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:57.251420 16267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:57.252830 16311 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:02:57.256711 16267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:02:57.256779 16267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:02:57.256845 16267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:02:57.258303 16267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:02:57.258369 16267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:57.258740 16311 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap starting.
I20260812 08:02:57.268464 16267 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:34007
I20260812 08:02:57.268514 16498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:34007 every 8 connection(s)
I20260812 08:02:57.269366 16267 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:57.274724  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 16267
I20260812 08:02:57.277657 16504 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:02:57.277875 16504 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:57.278421 16504 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:02:57.280098 16090 ts_manager.cc:194] Registered new tserver with Master: cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:02:57.281509 16090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:57343
I20260812 08:02:57.292542  9104 tablet_copy-itest.cc:1499] Blocks diff: 0
I20260812 08:02:57.298640 16311 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:57.324980 15159 raft_consensus.cc:1275] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Refusing update from remote peer e148dcbee1fe4d96bab45f72a90418a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:57.325194 14924 raft_consensus.cc:1275] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Refusing update from remote peer e148dcbee1fe4d96bab45f72a90418a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:57.325724 16259 consensus_queue.cc:1048] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:57.327526 16264 consensus_queue.cc:1048] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:57.334228 16521 mvcc.cc:204] Tried to move back new op lower bound from 7317593199928528896 to 7317593198923087872. Current Snapshot: MvccSnapshot[applied={T|T < 7317593199917404160}]
I20260812 08:02:57.340588 16522 mvcc.cc:204] Tried to move back new op lower bound from 7317593199925121024 to 7317593198923087872. Current Snapshot: MvccSnapshot[applied={T|T < 7317593199917404160}]
I20260812 08:02:57.342281 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.347019 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.348249 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.360246 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.010s	user 0.006s	sys 0.000s Metrics: {"bytes_written":9876,"cfile_init":1,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":493,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"thread_start_us":110,"threads_started":1}
I20260812 08:02:57.360801 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 1846 bytes on disk
I20260812 08:02:57.361217 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.382062 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.390547 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.043s	user 0.009s	sys 0.000s Metrics: {"bytes_written":9876,"cfile_init":1,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":508,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"thread_start_us":113,"threads_started":1}
I20260812 08:02:57.392087 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 1846 bytes on disk
I20260812 08:02:57.392460 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.392843 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.414512 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.032s	user 0.009s	sys 0.000s Metrics: {"bytes_written":9871,"cfile_init":1,"dirs.queue_time_us":9545,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":778,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":522,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"thread_start_us":125,"threads_started":1}
I20260812 08:02:57.415905 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 1862 bytes on disk
I20260812 08:02:57.416337 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.422410 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.008141
I20260812 08:02:57.428874 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.086s	user 0.022s	sys 0.000s Metrics: {"bytes_written":9876,"cfile_init":1,"compiler_manager_pool.queue_time_us":22237,"dirs.queue_time_us":14741,"dirs.run_cpu_time_us":184,"dirs.run_wall_time_us":599,"drs_written":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4,"lbm_write_time_us":562,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"thread_start_us":225,"threads_started":2}
I20260812 08:02:57.429788 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 1846 bytes on disk
I20260812 08:02:57.430297 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.430649 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.439086 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.016s	user 0.015s	sys 0.000s Metrics: {"bytes_written":15071,"cfile_cache_hit":10,"cfile_cache_hit_bytes":7510,"cfile_cache_miss":26,"cfile_cache_miss_bytes":21360,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":525,"dirs.run_cpu_time_us":275,"dirs.run_wall_time_us":1448,"drs_written":1,"lbm_read_time_us":597,"lbm_reads_lt_1ms":46,"lbm_write_time_us":705,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":400,"thread_start_us":260,"threads_started":4}
I20260812 08:02:57.439975 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 3582 bytes on disk
I20260812 08:02:57.440596 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.440912 16311 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=193} inserts{seen=550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:57.441186 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.441342 16311 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap complete.
I20260812 08:02:57.442757 16311 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Time spent bootstrapping tablet: real 0.184s	user 0.154s	sys 0.016s
I20260812 08:02:57.445240 16311 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:57.445647 16311 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc83802806d14ecba59903d3d4d6bf7f, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.446165 16311 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:02:57.447230 16311 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:02:57.447606 16504 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:02:57.453435 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 89073 bytes on disk
I20260812 08:02:57.454484 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.001s	user 0.001s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":108,"lbm_reads_lt_1ms":8}
I20260812 08:02:57.455459 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.014490
I20260812 08:02:57.470232 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.074s	user 0.004s	sys 0.004s Metrics: {"bytes_written":9871,"cfile_init":1,"dirs.queue_time_us":69,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":759,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":46569,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":200}
I20260812 08:02:57.470858 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.008141
I20260812 08:02:57.479804 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.049s	user 0.014s	sys 0.000s Metrics: {"bytes_written":15066,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":136,"dirs.run_wall_time_us":819,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":553,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":400}
I20260812 08:02:57.480649 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 3593 bytes on disk
I20260812 08:02:57.481061 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.481513 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.012177
I20260812 08:02:57.494591 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.053s	user 0.005s	sys 0.004s Metrics: {"bytes_written":9878,"cfile_init":1,"dirs.queue_time_us":1828,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":1298,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4825,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":200}
I20260812 08:02:57.500041 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.029s	user 0.015s	sys 0.000s Metrics: {"bytes_written":15071,"cfile_cache_hit":10,"cfile_cache_hit_bytes":7510,"cfile_cache_miss":26,"cfile_cache_miss_bytes":21360,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1108,"dirs.run_cpu_time_us":256,"dirs.run_wall_time_us":1332,"drs_written":1,"lbm_read_time_us":603,"lbm_reads_lt_1ms":50,"lbm_write_time_us":491,"lbm_writes_lt_1ms":23,"mutex_wait_us":1015,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":400,"spinlock_wait_cycles":768,"thread_start_us":237,"threads_started":4}
I20260812 08:02:57.500559 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.504391 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.010001
I20260812 08:02:57.526960 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.045s	user 0.023s	sys 0.000s Metrics: {"bytes_written":20250,"cfile_cache_hit":10,"cfile_cache_hit_bytes":11161,"cfile_cache_miss":26,"cfile_cache_miss_bytes":31559,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":165,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":757,"drs_written":1,"lbm_read_time_us":643,"lbm_reads_lt_1ms":46,"lbm_write_time_us":512,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":600,"spinlock_wait_cycles":2432,"thread_start_us":286,"threads_started":5}
I20260812 08:02:57.527421 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 5307 bytes on disk
I20260812 08:02:57.528787 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.028s	user 0.012s	sys 0.000s Metrics: {"bytes_written":17725,"cfile_init":1,"dirs.queue_time_us":3050,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":628,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":489,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":500}
I20260812 08:02:57.529358 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 8015 bytes on disk
I20260812 08:02:57.529706 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.530038 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.539908 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":101,"lbm_reads_lt_1ms":8}
I20260812 08:02:57.540385 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014053
I20260812 08:02:57.561903 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.032s	user 0.015s	sys 0.000s Metrics: {"bytes_written":17720,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":760,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":572,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":500}
I20260812 08:02:57.562438 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 4467 bytes on disk
I20260812 08:02:57.565659 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.566062 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013567
I20260812 08:02:57.575624 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.071s	user 0.015s	sys 0.004s Metrics: {"bytes_written":20250,"cfile_cache_hit":10,"cfile_cache_hit_bytes":11161,"cfile_cache_miss":26,"cfile_cache_miss_bytes":31573,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":6508,"dirs.run_cpu_time_us":263,"dirs.run_wall_time_us":3900,"drs_written":1,"lbm_read_time_us":1648,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":49,"lbm_write_time_us":2471,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"mutex_wait_us":1629,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":600}
I20260812 08:02:57.576181 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.607450 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.067s	user 0.024s	sys 0.000s Metrics: {"bytes_written":27983,"cfile_cache_hit":10,"cfile_cache_hit_bytes":16637,"cfile_cache_miss":26,"cfile_cache_miss_bytes":46941,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":547,"dirs.run_cpu_time_us":270,"dirs.run_wall_time_us":1371,"drs_written":1,"lbm_read_time_us":570,"lbm_reads_lt_1ms":46,"lbm_write_time_us":517,"lbm_writes_lt_1ms":23,"mutex_wait_us":203,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":900,"thread_start_us":69,"threads_started":1}
I20260812 08:02:57.608052 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.633510 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.067s	user 0.028s	sys 0.000s Metrics: {"bytes_written":33187,"cfile_cache_hit":10,"cfile_cache_hit_bytes":20287,"cfile_cache_miss":26,"cfile_cache_miss_bytes":57157,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":319,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":781,"drs_written":1,"lbm_read_time_us":694,"lbm_reads_lt_1ms":46,"lbm_write_time_us":634,"lbm_writes_lt_1ms":23,"mutex_wait_us":115,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1100}
I20260812 08:02:57.634004 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.639766 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.032s	user 0.014s	sys 0.000s Metrics: {"bytes_written":19014,"cfile_init":1,"dirs.queue_time_us":6075,"dirs.run_cpu_time_us":153,"dirs.run_wall_time_us":799,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":550,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":550}
I20260812 08:02:57.640375 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 12708 bytes on disk
I20260812 08:02:57.640868 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":105,"lbm_reads_lt_1ms":8}
I20260812 08:02:57.641357 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013866
I20260812 08:02:57.643224 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.067s	user 0.017s	sys 0.000s Metrics: {"bytes_written":22880,"cfile_init":1,"dirs.queue_time_us":15387,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":728,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":491,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":700}
I20260812 08:02:57.650399 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 11465 bytes on disk
I20260812 08:02:57.650933 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":100,"lbm_reads_lt_1ms":8}
I20260812 08:02:57.651453 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013591
I20260812 08:02:57.686842 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.052s	user 0.015s	sys 0.001s Metrics: {"bytes_written":17715,"cfile_init":1,"compiler_manager_pool.queue_time_us":63942,"compiler_manager_pool.run_cpu_time_us":12,"compiler_manager_pool.run_wall_time_us":11,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":887,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":534,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":500}
I20260812 08:02:57.687364 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 14035 bytes on disk
I20260812 08:02:57.687803 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":98,"lbm_reads_lt_1ms":8}
I20260812 08:02:57.688182 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.012397
I20260812 08:02:57.702278 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.061s	user 0.031s	sys 0.000s Metrics: {"bytes_written":42242,"cfile_cache_hit":10,"cfile_cache_hit_bytes":26677,"cfile_cache_miss":26,"cfile_cache_miss_bytes":74687,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":121,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":1164,"drs_written":1,"lbm_read_time_us":582,"lbm_reads_lt_1ms":46,"lbm_write_time_us":617,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1450,"spinlock_wait_cycles":11776}
I20260812 08:02:57.704854 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 12550 bytes on disk
I20260812 08:02:57.706820 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.707185 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.738449 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.031s	user 0.015s	sys 0.000s Metrics: {"bytes_written":19042,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":1062,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":490,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":550}
I20260812 08:02:57.738965 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 4850 bytes on disk
I20260812 08:02:57.739308 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.739753 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014340
I20260812 08:02:57.749418 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.051s	user 0.033s	sys 0.002s Metrics: {"bytes_written":46010,"cfile_cache_hit":10,"cfile_cache_hit_bytes":29412,"cfile_cache_miss":26,"cfile_cache_miss_bytes":82416,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":7128,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":819,"drs_written":1,"lbm_read_time_us":693,"lbm_reads_lt_1ms":46,"lbm_write_time_us":632,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1600}
I20260812 08:02:57.750171 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 13911 bytes on disk
I20260812 08:02:57.750478 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.750793 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.783128 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.032s	user 0.013s	sys 0.004s Metrics: {"bytes_written":22917,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":742,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":466,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":700}
I20260812 08:02:57.783651 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014073
I20260812 08:02:57.784556 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.045s	user 0.041s	sys 0.000s Metrics: {"bytes_written":60242,"cfile_cache_hit":10,"cfile_cache_hit_bytes":36717,"cfile_cache_miss":26,"cfile_cache_miss_bytes":102605,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":186,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":1342,"drs_written":1,"lbm_read_time_us":606,"lbm_reads_lt_1ms":46,"lbm_write_time_us":617,"lbm_writes_lt_1ms":24,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2000}
I20260812 08:02:57.784993 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 17534 bytes on disk
I20260812 08:02:57.785317 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.785660 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.819275 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.168s	user 0.031s	sys 0.000s Metrics: {"bytes_written":38298,"cfile_cache_hit":10,"cfile_cache_hit_bytes":23937,"cfile_cache_miss":26,"cfile_cache_miss_bytes":67209,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":872,"dirs.run_cpu_time_us":447,"dirs.run_wall_time_us":2572,"drs_written":1,"lbm_read_time_us":627,"lbm_reads_lt_1ms":46,"lbm_write_time_us":588,"lbm_writes_lt_1ms":23,"mutex_wait_us":680,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1300}
I20260812 08:02:57.820281 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 11270 bytes on disk
I20260812 08:02:57.822659 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.823320 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.843245 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.058s	user 0.042s	sys 0.005s Metrics: {"bytes_written":68205,"cfile_cache_hit":10,"cfile_cache_hit_bytes":42187,"cfile_cache_miss":26,"cfile_cache_miss_bytes":117643,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":813,"drs_written":1,"lbm_read_time_us":644,"lbm_reads_lt_1ms":50,"lbm_write_time_us":648,"lbm_writes_lt_1ms":24,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2300}
I20260812 08:02:57.843726 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 20246 bytes on disk
I20260812 08:02:57.844070 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.844413 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.852608 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.067s	user 0.012s	sys 0.000s Metrics: {"bytes_written":16440,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":917,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":470,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":450}
I20260812 08:02:57.853123 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 3999 bytes on disk
I20260812 08:02:57.853454 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.853854 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.012372
I20260812 08:02:57.892798 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.048s	user 0.010s	sys 0.003s Metrics: {"bytes_written":17733,"cfile_init":1,"dirs.queue_time_us":2343,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":831,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":503,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":500}
I20260812 08:02:57.893374 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013137
I20260812 08:02:57.898999 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.075s	user 0.025s	sys 0.001s Metrics: {"bytes_written":34503,"cfile_init":1,"dirs.queue_time_us":9598,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":868,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":473,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1150}
I20260812 08:02:57.899591 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013712
I20260812 08:02:57.949424 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.488s	user 0.191s	sys 0.000s Metrics: {"bytes_written":277881,"cfile_cache_hit":10,"cfile_cache_hit_bytes":180853,"cfile_cache_miss":32,"cfile_cache_miss_bytes":501773,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":13406,"dirs.run_cpu_time_us":152,"dirs.run_wall_time_us":518,"drs_written":1,"lbm_read_time_us":1139,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1343,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":149657,"rows_written":9650,"thread_start_us":437,"threads_started":7,"wal-append.queue_time_us":149}
I20260812 08:02:57.950114 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 90278 bytes on disk
I20260812 08:02:57.950579 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.960573 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling FlushMRSOp(a6a1bb938f084feda86bec0572064f40): perf score=1.000000
I20260812 08:02:57.985121 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.131s	user 0.049s	sys 0.000s Metrics: {"bytes_written":71947,"cfile_cache_hit":11,"cfile_cache_hit_bytes":51705,"cfile_cache_miss":25,"cfile_cache_miss_bytes":118443,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":3258,"dirs.run_cpu_time_us":288,"dirs.run_wall_time_us":1733,"drs_written":1,"lbm_read_time_us":585,"lbm_reads_lt_1ms":45,"lbm_write_time_us":622,"lbm_writes_lt_1ms":25,"mutex_wait_us":622,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2450}
I20260812 08:02:57.985621 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 21846 bytes on disk
I20260812 08:02:57.985965 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.986328 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:57.987319 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: FlushMRSOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.027s	user 0.018s	sys 0.000s Metrics: {"bytes_written":18999,"cfile_init":1,"compiler_manager_pool.queue_time_us":13028,"dirs.queue_time_us":3017,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":378,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":502,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":550,"thread_start_us":73,"threads_started":1}
I20260812 08:02:57.987844 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 4888 bytes on disk
I20260812 08:02:57.988186 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 08:02:57.988562 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40): perf score=1.013814
I20260812 08:02:58.051915 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.158s	user 0.055s	sys 0.000s Metrics: {"bytes_written":80976,"cfile_cache_hit":11,"cfile_cache_hit_bytes":59115,"cfile_cache_miss":25,"cfile_cache_miss_bytes":135809,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":754,"drs_written":1,"lbm_read_time_us":20705,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":48,"lbm_write_time_us":673,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":68503,"rows_written":2800}
I20260812 08:02:58.052718 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.062593 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.149s	user 0.048s	sys 0.003s Metrics: {"bytes_written":71947,"cfile_cache_hit":10,"cfile_cache_hit_bytes":44927,"cfile_cache_miss":26,"cfile_cache_miss_bytes":125231,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":358,"dirs.run_cpu_time_us":563,"dirs.run_wall_time_us":2959,"drs_written":1,"lbm_read_time_us":760,"lbm_reads_lt_1ms":50,"lbm_write_time_us":5677,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":24,"mutex_wait_us":85,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2450,"spinlock_wait_cycles":1920,"thread_start_us":85,"threads_started":1}
I20260812 08:02:58.063491 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 21846 bytes on disk
I20260812 08:02:58.064072 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 08:02:58.064554 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.068477 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.082s	user 0.026s	sys 0.000s Metrics: {"bytes_written":35744,"cfile_init":1,"dirs.queue_time_us":5933,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":855,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":505,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1200,"spinlock_wait_cycles":30592}
I20260812 08:02:58.072160 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014411
I20260812 08:02:58.102016 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.049s	user 0.025s	sys 0.000s Metrics: {"bytes_written":34460,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":859,"drs_written":1,"lbm_read_time_us":775,"lbm_reads_lt_1ms":4,"lbm_write_time_us":502,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1150}
I20260812 08:02:58.102569 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014371
I20260812 08:02:58.186995 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.122s	user 0.029s	sys 0.003s Metrics: {"bytes_written":43411,"cfile_init":1,"dirs.queue_time_us":108,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":930,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":589,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1500}
I20260812 08:02:58.187690 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014682
I20260812 08:02:58.226595 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: CompactRowSetsOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.238s	user 0.182s	sys 0.004s Metrics: {"bytes_written":292054,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192015,"cfile_cache_miss":34,"cfile_cache_miss_bytes":532845,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":206,"dirs.run_cpu_time_us":392,"dirs.run_wall_time_us":2605,"drs_written":1,"lbm_read_time_us":1046,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1245,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":158590,"rows_written":10200}
I20260812 08:02:58.227375 16505 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 95499 bytes on disk
I20260812 08:02:58.227952 16308 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20260812 08:02:58.278672 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.172s	user 0.070s	sys 0.004s Metrics: {"bytes_written":114430,"cfile_cache_hit":10,"cfile_cache_hit_bytes":72325,"cfile_cache_miss":28,"cfile_cache_miss_bytes":202427,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":734,"drs_written":1,"lbm_read_time_us":881,"lbm_reads_lt_1ms":56,"lbm_write_time_us":757,"lbm_writes_lt_1ms":26,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3950}
I20260812 08:02:58.279171 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.302294  9104 tablet_copy-itest.cc:1499] Blocks diff: 10
I20260812 08:02:58.322917 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.250s	user 0.067s	sys 0.004s Metrics: {"bytes_written":106544,"cfile_cache_hit":10,"cfile_cache_hit_bytes":66850,"cfile_cache_miss":28,"cfile_cache_miss_bytes":186710,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":693,"dirs.run_cpu_time_us":514,"dirs.run_wall_time_us":3317,"drs_written":1,"lbm_read_time_us":776,"lbm_reads_lt_1ms":52,"lbm_write_time_us":852,"lbm_writes_lt_1ms":26,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3650,"thread_start_us":100,"threads_started":2}
I20260812 08:02:58.323522 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.346328 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.067s	user 0.027s	sys 0.000s Metrics: {"bytes_written":37150,"cfile_init":1,"dirs.queue_time_us":11015,"dirs.run_cpu_time_us":136,"dirs.run_wall_time_us":910,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":561,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1250}
I20260812 08:02:58.346930 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014583
I20260812 08:02:58.365033 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.041s	user 0.029s	sys 0.000s Metrics: {"bytes_written":44691,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":896,"drs_written":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4,"lbm_write_time_us":541,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1550}
I20260812 08:02:58.367532 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014706
I20260812 08:02:58.405911 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.217s	user 0.070s	sys 0.004s Metrics: {"bytes_written":114430,"cfile_cache_hit":10,"cfile_cache_hit_bytes":72325,"cfile_cache_miss":28,"cfile_cache_miss_bytes":201705,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":11035,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":1110,"drs_written":1,"lbm_read_time_us":784,"lbm_reads_lt_1ms":52,"lbm_write_time_us":16093,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3950}
I20260812 08:02:58.407181 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 35580 bytes on disk
I20260812 08:02:58.407552 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 08:02:58.409515 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.466977 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.057s	user 0.036s	sys 0.000s Metrics: {"bytes_written":53917,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":966,"drs_written":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4,"lbm_write_time_us":539,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1750}
I20260812 08:02:58.467585 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014549
I20260812 08:02:58.484221 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.137s	user 0.093s	sys 0.000s Metrics: {"bytes_written":151647,"cfile_cache_hit":11,"cfile_cache_hit_bytes":108064,"cfile_cache_miss":27,"cfile_cache_miss_bytes":253348,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":1138,"drs_written":1,"lbm_read_time_us":823,"lbm_reads_lt_1ms":55,"lbm_write_time_us":983,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":81656,"rows_written":5200}
I20260812 08:02:58.484745 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 47433 bytes on disk
I20260812 08:02:58.485224 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 08:02:58.485605 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.512504 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.143s	user 0.091s	sys 0.004s Metrics: {"bytes_written":151647,"cfile_cache_hit":10,"cfile_cache_hit_bytes":95140,"cfile_cache_miss":28,"cfile_cache_miss_bytes":265312,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":292,"dirs.run_cpu_time_us":362,"dirs.run_wall_time_us":1959,"drs_written":1,"lbm_read_time_us":822,"lbm_reads_lt_1ms":56,"lbm_write_time_us":920,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":81356,"rows_written":5200}
I20260812 08:02:58.513000 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.517961 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.032s	user 0.022s	sys 0.000s Metrics: {"bytes_written":30633,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":842,"drs_written":1,"lbm_read_time_us":148,"lbm_reads_lt_1ms":4,"lbm_write_time_us":514,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1000}
I20260812 08:02:58.518680 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013729
I20260812 08:02:58.549866 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.036s	user 0.024s	sys 0.000s Metrics: {"bytes_written":33189,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":815,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":704,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 08:02:58.550411 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 56991 bytes on disk
I20260812 08:02:58.552693 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":96,"lbm_reads_lt_1ms":8}
I20260812 08:02:58.553172 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013739
I20260812 08:02:58.612310 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.143s	user 0.106s	sys 0.000s Metrics: {"bytes_written":164923,"cfile_cache_hit":12,"cfile_cache_hit_bytes":130113,"cfile_cache_miss":26,"cfile_cache_miss_bytes":265205,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":188,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":869,"drs_written":1,"lbm_read_time_us":840,"lbm_reads_lt_1ms":50,"lbm_write_time_us":1018,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":88781,"rows_written":5700,"spinlock_wait_cycles":896}
I20260812 08:02:58.613317 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.646453 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.033s	user 0.021s	sys 0.000s Metrics: {"bytes_written":29345,"cfile_init":1,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":829,"drs_written":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4,"lbm_write_time_us":457,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":950}
I20260812 08:02:58.647078 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 60357 bytes on disk
I20260812 08:02:58.647589 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":97,"lbm_reads_lt_1ms":8}
I20260812 08:02:58.648078 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014690
I20260812 08:02:58.674921 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.156s	user 0.106s	sys 0.006s Metrics: {"bytes_written":178136,"cfile_cache_hit":10,"cfile_cache_hit_bytes":114514,"cfile_cache_miss":30,"cfile_cache_miss_bytes":319548,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":213,"dirs.run_cpu_time_us":378,"dirs.run_wall_time_us":2280,"drs_written":1,"lbm_read_time_us":833,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1005,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":97149,"rows_written":6200}
I20260812 08:02:58.675597 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.690281 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.130s	user 0.106s	sys 0.004s Metrics: {"bytes_written":180790,"cfile_cache_hit":10,"cfile_cache_hit_bytes":116339,"cfile_cache_miss":30,"cfile_cache_miss_bytes":324553,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":182,"dirs.run_cpu_time_us":387,"dirs.run_wall_time_us":2380,"drs_written":1,"lbm_read_time_us":822,"lbm_reads_lt_1ms":50,"lbm_write_time_us":997,"lbm_writes_lt_1ms":28,"mutex_wait_us":3,"num_input_rowsets":2,"peak_mem_usage":98574,"rows_written":6300}
I20260812 08:02:58.690894 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.721282 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.029s	user 0.015s	sys 0.004s Metrics: {"bytes_written":25404,"cfile_init":1,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":838,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":543,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800}
I20260812 08:02:58.721822 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014677
I20260812 08:02:58.806957 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.120s	user 0.025s	sys 0.002s Metrics: {"bytes_written":35788,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":157,"dirs.run_wall_time_us":1080,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":608,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1200}
I20260812 08:02:58.807618 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014884
I20260812 08:02:58.900331 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.176s	user 0.115s	sys 0.008s Metrics: {"bytes_written":206181,"cfile_cache_hit":10,"cfile_cache_hit_bytes":132040,"cfile_cache_miss":30,"cfile_cache_miss_bytes":366758,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":11569,"dirs.run_cpu_time_us":349,"dirs.run_wall_time_us":2142,"drs_written":1,"lbm_read_time_us":938,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1115,"lbm_writes_lt_1ms":30,"mutex_wait_us":11386,"num_input_rowsets":2,"peak_mem_usage":111074,"rows_written":7100}
I20260812 08:02:58.901077 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.982980 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.335s	user 0.115s	sys 0.004s Metrics: {"bytes_written":190317,"cfile_cache_hit":10,"cfile_cache_hit_bytes":123229,"cfile_cache_miss":30,"cfile_cache_miss_bytes":343257,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":202,"dirs.run_cpu_time_us":438,"dirs.run_wall_time_us":2589,"drs_written":1,"lbm_read_time_us":822,"lbm_reads_lt_1ms":50,"lbm_write_time_us":976,"lbm_writes_lt_1ms":29,"num_input_rowsets":2,"peak_mem_usage":104064,"rows_written":6650}
I20260812 08:02:58.983765 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:58.985894 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.084s	user 0.035s	sys 0.000s Metrics: {"bytes_written":48610,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":874,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":537,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1700}
I20260812 08:02:58.986497 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014288
I20260812 08:02:59.019069  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 16267
I20260812 08:02:59.068553 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.085s	user 0.048s	sys 0.000s Metrics: {"bytes_written":70486,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":989,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":671,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":2400}
I20260812 08:02:59.069218 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 82220 bytes on disk
I20260812 08:02:59.069739 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":102,"lbm_reads_lt_1ms":8}
I20260812 08:02:59.070209 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014341
I20260812 08:02:59.081393 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.271s	user 0.127s	sys 0.004s Metrics: {"bytes_written":214069,"cfile_cache_hit":10,"cfile_cache_hit_bytes":137414,"cfile_cache_miss":30,"cfile_cache_miss_bytes":381866,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":971,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":803,"drs_written":1,"lbm_read_time_us":917,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1028,"lbm_writes_lt_1ms":30,"mutex_wait_us":222,"num_input_rowsets":2,"peak_mem_usage":115249,"rows_written":7400}
I20260812 08:02:59.081897 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:59.137789 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.056s	user 0.054s	sys 0.000s Metrics: {"bytes_written":81031,"cfile_init":1,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":935,"drs_written":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4,"lbm_write_time_us":605,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":2800,"spinlock_wait_cycles":896}
I20260812 08:02:59.138402 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 92896 bytes on disk
I20260812 08:02:59.138863 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":95,"lbm_reads_lt_1ms":8}
I20260812 08:02:59.139293 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.014029
I20260812 08:02:59.171125 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.184s	user 0.154s	sys 0.008s Metrics: {"bytes_written":255394,"cfile_cache_hit":10,"cfile_cache_hit_bytes":163887,"cfile_cache_miss":32,"cfile_cache_miss_bytes":454981,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":346,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":2144,"drs_written":1,"lbm_read_time_us":1005,"lbm_reads_lt_1ms":60,"lbm_write_time_us":6733,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"mutex_wait_us":21,"num_input_rowsets":2,"peak_mem_usage":136092,"rows_written":8800,"spinlock_wait_cycles":3456}
I20260812 08:02:59.171846 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 81825 bytes on disk
I20260812 08:02:59.172278 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 08:02:59.172719 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
I20260812 08:02:59.180027 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.110s	user 0.106s	sys 0.003s Metrics: {"bytes_written":261953,"cfile_cache_hit":10,"cfile_cache_hit_bytes":168025,"cfile_cache_miss":34,"cfile_cache_miss_bytes":467023,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":306,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":922,"drs_written":1,"lbm_read_time_us":777,"lbm_reads_lt_1ms":54,"lbm_write_time_us":942,"lbm_writes_lt_1ms":32,"mutex_wait_us":48,"num_input_rowsets":2,"peak_mem_usage":138798,"rows_written":9050}
I20260812 08:02:59.180538 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 84624 bytes on disk
I20260812 08:02:59.180917 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4}
I20260812 08:02:59.181281 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling FlushMRSOp(7dc68e6a467043928d0404bca8788431): perf score=1.000000
W20260812 08:02:59.197374 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:59.201464 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.029s	user 0.027s	sys 0.000s Metrics: {"bytes_written":40927,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":493,"drs_written":1,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4,"lbm_write_time_us":492,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1400}
I20260812 08:02:59.201927 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013192
I20260812 08:02:59.207494 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: FlushMRSOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.026s	user 0.024s	sys 0.000s Metrics: {"bytes_written":34473,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":537,"drs_written":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4,"lbm_write_time_us":498,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1150}
I20260812 08:02:59.208029 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling CompactRowSetsOp(7dc68e6a467043928d0404bca8788431): perf score=1.013144
I20260812 08:02:59.318138 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.116s	user 0.116s	sys 0.000s Metrics: {"bytes_written":292073,"cfile_cache_hit":10,"cfile_cache_hit_bytes":191160,"cfile_cache_miss":34,"cfile_cache_miss_bytes":530170,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":309,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":1816,"drs_written":1,"lbm_read_time_us":837,"lbm_reads_lt_1ms":58,"lbm_write_time_us":975,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":157740,"rows_written":10200}
I20260812 08:02:59.318717 15012 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 95797 bytes on disk
I20260812 08:02:59.319077 14809 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":41,"lbm_reads_lt_1ms":4}
I20260812 08:02:59.325464 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.186s	user 0.170s	sys 0.012s Metrics: {"bytes_written":292073,"cfile_cache_hit":10,"cfile_cache_hit_bytes":189760,"cfile_cache_miss":34,"cfile_cache_miss_bytes":526998,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":775,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":991,"drs_written":1,"lbm_read_time_us":1084,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1319,"lbm_writes_lt_1ms":32,"mutex_wait_us":164,"num_input_rowsets":2,"peak_mem_usage":156847,"rows_written":10200}
I20260812 08:02:59.326014 15926 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 95797 bytes on disk
I20260812 08:02:59.326329 15720 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":42,"lbm_reads_lt_1ms":4}
I20260812 08:02:59.368149 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: CompactRowSetsOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.160s	user 0.157s	sys 0.003s Metrics: {"bytes_written":292073,"cfile_cache_hit":10,"cfile_cache_hit_bytes":191415,"cfile_cache_miss":34,"cfile_cache_miss_bytes":531431,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":452,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":913,"drs_written":1,"lbm_read_time_us":908,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1071,"lbm_writes_lt_1ms":32,"mutex_wait_us":38,"num_input_rowsets":2,"peak_mem_usage":156390,"rows_written":10200,"spinlock_wait_cycles":896}
I20260812 08:02:59.368649 15247 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 95797 bytes on disk
I20260812 08:02:59.369045 15046 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4}
W20260812 08:03:01.385455 14808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260812 08:03:01.780733 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 08:03:04.430166 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 08:03:06.562752 14808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260812 08:03:06.982156 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 08:03:09.293473 16626 consensus_queue.cc:579] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Leader has been unable to successfully communicate with peer cc83802806d14ecba59903d3d4d6bf7f for more than 10 seconds (10.551s)
W20260812 08:03:09.295136 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260812 08:03:09.296906 14924 consensus_queue.cc:237] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 205, Committed index: 205, Last appended: 1.205, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:09.298437 15159 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 1 index: 206. (index mismatch)
I20260812 08:03:09.298863 16666 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
W20260812 08:03:09.299789 14808 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): Couldn't send request to peer cc83802806d14ecba59903d3d4d6bf7f. Status: Network error: Client connection negotiation failed: client connection to 127.8.228.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:09.300840 16670 raft_consensus.cc:2955] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 LEADER]: Committing config change with OpId 1.206: config changed from index -1 to 206, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } } }
I20260812 08:03:09.301327 15159 raft_consensus.cc:2955] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Committing config change with OpId 1.206: config changed from index -1 to 206, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } } }
W20260812 08:03:09.302619 14807 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): Couldn't send request to peer e148dcbee1fe4d96bab45f72a90418a4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6a1bb938f084feda86bec0572064f40. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:09.302906 16062 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a6a1bb938f084feda86bec0572064f40 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 08:03:09.303612 16073 catalog_manager.cc:5719] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 reported cstate change: config changed from index -1 to 206, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) added. New cstate: current_term: 1 leader_uuid: "f492a4e4cbba4f93a706a4048833cbd6" committed_config { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 08:03:09.720897 16693 ts_tablet_manager.cc:933] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Initiating tablet copy from peer f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:03:09.721365 16693 tablet_copy_client.cc:323] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.2:45805
I20260812 08:03:09.722126 14964 tablet_copy_service.cc:140] P f492a4e4cbba4f93a706a4048833cbd6: Received BeginTabletCopySession request for tablet a6a1bb938f084feda86bec0572064f40 from peer e148dcbee1fe4d96bab45f72a90418a4 ({username='slave'} at 127.8.228.4:53145)
I20260812 08:03:09.722288 14964 tablet_copy_service.cc:161] P f492a4e4cbba4f93a706a4048833cbd6: Beginning new tablet copy session on tablet a6a1bb938f084feda86bec0572064f40 from peer e148dcbee1fe4d96bab45f72a90418a4 at {username='slave'} at 127.8.228.4:53145: session id = e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40
I20260812 08:03:09.723703 14964 tablet_copy_source_session.cc:215] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Tablet Copy: opened 5 blocks and 1 log segments
W20260812 08:03:09.724149 14964 tablet_copy_service.cc:227] P f492a4e4cbba4f93a706a4048833cbd6: Timing out tablet copy session due to flag --tablet_copy_early_session_timeout_prob being set to 1
I20260812 08:03:09.724287 14964 tablet_copy_service.cc:434] P f492a4e4cbba4f93a706a4048833cbd6: ending tablet copy session e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40 on tablet a6a1bb938f084feda86bec0572064f40 with peer e148dcbee1fe4d96bab45f72a90418a4
I20260812 08:03:09.725603 16693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a1bb938f084feda86bec0572064f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:09.727618 16693 tablet_copy_client.cc:806] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Starting download of 5 data blocks...
W20260812 08:03:09.728453 14964 tablet_copy_service.cc:479] P f492a4e4cbba4f93a706a4048833cbd6: Error handling TabletCopyService RPC request from {username='slave'} at 127.8.228.4:53145: No such session: Not found: Tablet Copy session with Session ID "e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40" not found
W20260812 08:03:09.730423 16693 ts_tablet_manager.cc:1011] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Tablet Copy: Unable to fetch data from remote peer f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): Remote error: Unable to download block with id 7747285402127150230: Unable to download block 7747285402127150230: unable to fetch data from remote: No such session: NO_SESSION: received error code Not found: Tablet Copy session with Session ID "e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40" not found from remote service
I20260812 08:03:09.730509 16693 tablet_replica.cc:333] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: stopping tablet replica
I20260812 08:03:09.730578 16693 raft_consensus.cc:2243] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 LEARNER]: Raft consensus shutting down.
I20260812 08:03:09.730640 16693 raft_consensus.cc:2272] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 LEARNER]: Raft consensus is shut down!
I20260812 08:03:09.731153 14964 tablet_copy_service.cc:342] P f492a4e4cbba4f93a706a4048833cbd6: Request end of tablet copy session e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40 received from {username='slave'} at 127.8.228.4:53145
W20260812 08:03:09.731228 14964 tablet_copy_service.cc:479] P f492a4e4cbba4f93a706a4048833cbd6: Error handling TabletCopyService RPC request from {username='slave'} at 127.8.228.4:53145: No such session: Not found: Tablet Copy session with Session ID "e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40" not found
W20260812 08:03:09.731564 16693 tablet_copy_client.cc:1130] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Unable to close tablet copy session: Remote error: failure ending tablet copy session: No such session: NO_SESSION: received error code Not found: Tablet Copy session with Session ID "e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40" not found from remote service
W20260812 08:03:09.732123 16693 tablet_metadata.cc:474] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet a6a1bb938f084feda86bec0572064f40 but one is already registered
I20260812 08:03:09.732228 16693 ts_tablet_manager.cc:1916] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:03:09.733784 16693 ts_tablet_manager.cc:1929] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20260812 08:03:10.085696  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 14779
I20260812 08:03:10.107242  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 15015
I20260812 08:03:10.119652  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 15686
I20260812 08:03:10.130231  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 16028
I20260812 08:03:10.141773  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--webserver_interface=127.8.228.62
--webserver_port=41681
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000 with env {}
W20260812 08:03:10.241405 16701 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:10.241564 16701 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:10.241603 16701 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:10.244773 16701 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:10.244823 16701 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:10.244841 16701 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:10.244858 16701 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:10.248482 16701 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.228.62:35979
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.228.62:35979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.228.62
--webserver_port=41681
--never_fsync=true
--heap_profile_path=/tmp/kudu.16701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:10.249279 16701 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:10.250185 16701 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:10.254896 16712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.254901 16721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.254901 16713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:10.255012 16701 server_base.cc:1061] running on GCE node
I20260812 08:03:10.255540 16701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:10.256297 16701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:10.257439 16701 hybrid_clock.cc:648] HybridClock initialized: now 1786521790257416 us; error 35 us; skew 500 ppm
I20260812 08:03:10.258934 16701 webserver.cc:533] Webserver started at http://127.8.228.62:41681/ using document root <none> and password file <none>
I20260812 08:03:10.259414 16701 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:10.259470 16701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:10.262331 16701 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:03:10.264073 16738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:10.264930 16701 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:03:10.265033 16701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
uuid: "12e3751703744ce7a01d6b70ca4ac8f0"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:03:10.265357 16701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:10.290927 16701 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:10.291417 16701 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:10.291564 16701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:10.297989 16701 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.62:35979
I20260812 08:03:10.297986 16824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.62:35979 every 8 connection(s)
I20260812 08:03:10.298929 16701 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:10.302415 16825 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:10.303741 16825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap starting.
I20260812 08:03:10.307586  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 16701
I20260812 08:03:10.307979  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.1:34007
--local_ip_for_outbound_sockets=127.8.228.1
--tserver_master_addrs=127.8.228.62:35979
--webserver_port=39159
--webserver_interface=127.8.228.1
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 08:03:10.317917 16825 log.cc:826] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:10.326776 16825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=7 ignored=0} mutations{seen=5 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:10.327055 16825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Bootstrap complete.
I20260812 08:03:10.330161 16825 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:03:10.330474 16825 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Initialized, Role: FOLLOWER
I20260812 08:03:10.330940 16825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 3.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:03:10.331059 16825 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:03:10.331127 16825 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:03:10.331224 16825 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:10.332557 16825 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:03:10.332847 16825 leader_election.cc:304] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12e3751703744ce7a01d6b70ca4ac8f0; no voters: 
I20260812 08:03:10.333086 16825 leader_election.cc:290] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [CANDIDATE]: Term 4 election: Requested vote from peers 
I20260812 08:03:10.333179 16834 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 08:03:10.333360 16834 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [term 4 LEADER]: Becoming Leader. State: Replica: 12e3751703744ce7a01d6b70ca4ac8f0, State: Running, Role: LEADER
I20260812 08:03:10.333681 16834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 3.13, Last appended by leader: 13, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } }
I20260812 08:03:10.334096 16825 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:10.334496 16834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12e3751703744ce7a01d6b70ca4ac8f0. Latest consensus state: current_term: 4 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:03:10.334659 16834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:10.334846 16836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 leader_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12e3751703744ce7a01d6b70ca4ac8f0" member_type: VOTER last_known_addr { host: "127.8.228.62" port: 35979 } } }
I20260812 08:03:10.334987 16836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:10.335243 16840 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:10.338506 16840 catalog_manager.cc:679] Loaded metadata for table table_b [id=1e45fcbd969e4fe0a889aa0d0186f446]
I20260812 08:03:10.338810 16840 catalog_manager.cc:679] Loaded metadata for table table_a [id=bcdf38cbb8b44f78851861b7d36b8506]
I20260812 08:03:10.339923 16840 tablet_loader.cc:96] loaded metadata for tablet 7dc68e6a467043928d0404bca8788431 (table table_b [id=1e45fcbd969e4fe0a889aa0d0186f446])
I20260812 08:03:10.340174 16840 tablet_loader.cc:96] loaded metadata for tablet a6a1bb938f084feda86bec0572064f40 (table table_a [id=bcdf38cbb8b44f78851861b7d36b8506])
I20260812 08:03:10.340287 16840 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:10.340866 16840 catalog_manager.cc:1295] Loaded cluster ID: a38f66dc7a1e4f9cb06b7cf4131f1ad9
I20260812 08:03:10.340917 16840 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:10.342571 16840 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:10.343114 16840 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 12e3751703744ce7a01d6b70ca4ac8f0: Loaded TSK: 0
I20260812 08:03:10.343778 16840 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:03:10.436044 16829 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:10.436277 16829 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:10.436359 16829 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:10.440790 16829 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:10.440886 16829 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:03:10.440953 16829 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.1
I20260812 08:03:10.446094 16829 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.1:34007
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.228.1
--webserver_port=39159
--flush_threshold_mb=0
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.16829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:10.447116 16829 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:10.448151 16829 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:10.454068 16863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.454079 16866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.454267 16864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:10.454967 16829 server_base.cc:1061] running on GCE node
I20260812 08:03:10.455293 16829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:10.455770 16829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:10.456939 16829 hybrid_clock.cc:648] HybridClock initialized: now 1786521790456922 us; error 32 us; skew 500 ppm
I20260812 08:03:10.458535 16829 webserver.cc:533] Webserver started at http://127.8.228.1:39159/ using document root <none> and password file <none>
I20260812 08:03:10.459030 16829 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:10.459091 16829 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:10.462158 16829 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:10.467284 16891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:10.468113 16829 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.001s
I20260812 08:03:10.468200 16829 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
uuid: "cc83802806d14ecba59903d3d4d6bf7f"
format_stamp: "Formatted at 2026-08-12 08:02:51 on dist-test-slave-6zbq"
I20260812 08:03:10.468526 16829 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/data
Total live blocks: 5
Total live bytes: 387553
Total live bytes (after alignment): 401408
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:10.486115 16829 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:10.486637 16829 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:10.486783 16829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:10.487282 16829 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:10.488360 16900 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:10.491806 16829 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:10.491858 16829 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:03:10.491899 16829 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:10.493286 16829 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:10.493350 16829 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:03:10.493626 16900 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap starting.
I20260812 08:03:10.504554 16829 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.1:34007
I20260812 08:03:10.505573 16829 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:10.506248 17099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.1:34007 every 8 connection(s)
I20260812 08:03:10.514782  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 16829
I20260812 08:03:10.515242  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.2:45805
--local_ip_for_outbound_sockets=127.8.228.2
--tserver_master_addrs=127.8.228.62:35979
--webserver_port=33001
--webserver_interface=127.8.228.2
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 08:03:10.521173 17104 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:03:10.521378 17104 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:10.521883 17104 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:03:10.524398 16761 ts_manager.cc:194] Registered new tserver with Master: cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:03:10.527117 16761 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.1:53935
I20260812 08:03:10.534237 16900 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:10.617503 16900 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:10.617856 16900 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Bootstrap complete.
I20260812 08:03:10.618881 16900 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Time spent bootstrapping tablet: real 0.126s	user 0.113s	sys 0.012s
I20260812 08:03:10.620788 16900 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:03:10.621109 16900 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc83802806d14ecba59903d3d4d6bf7f, State: Initialized, Role: FOLLOWER
I20260812 08:03:10.621515 16900 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:03:10.622175 17104 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:03:10.622327 16900 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
W20260812 08:03:10.626900 17109 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:10.627046 17109 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:10.627101 17109 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260812 08:03:10.629609 17105 maintenance_manager.cc:419] P cc83802806d14ecba59903d3d4d6bf7f: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 95499 bytes on disk
W20260812 08:03:10.630261 17109 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:10.630332 17109 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:03:10.630429 17109 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.2
I20260812 08:03:10.630317 16897 maintenance_manager.cc:643] P cc83802806d14ecba59903d3d4d6bf7f: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 08:03:10.634032 17109 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.2:45805
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.228.2
--webserver_port=33001
--flush_threshold_mb=0
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.17109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:10.634938 17109 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:10.635906 17109 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:10.641320 17121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.641325 17124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.641479 17127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:10.641636 17109 server_base.cc:1061] running on GCE node
I20260812 08:03:10.641921 17109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:10.642367 17109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:10.643518 17109 hybrid_clock.cc:648] HybridClock initialized: now 1786521790643507 us; error 30 us; skew 500 ppm
I20260812 08:03:10.644963 17109 webserver.cc:533] Webserver started at http://127.8.228.2:33001/ using document root <none> and password file <none>
I20260812 08:03:10.645427 17109 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:10.645493 17109 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:10.648453 17109 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:10.654392 17157 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:10.655164 17109 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
I20260812 08:03:10.655251 17109 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
uuid: "f492a4e4cbba4f93a706a4048833cbd6"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:03:10.655568 17109 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/data
Total live blocks: 10
Total live bytes: 775423
Total live bytes (after alignment): 802816
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:10.671710 17109 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:10.672246 17109 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:10.672407 17109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:10.672888 17109 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:10.673923 17167 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260812 08:03:10.678192 17109 ts_tablet_manager.cc:585] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20260812 08:03:10.678244 17109 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:03:10.678308 17109 ts_tablet_manager.cc:600] Registering tablets (0/2 complete)
I20260812 08:03:10.679970 17167 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap starting.
I20260812 08:03:10.680120 17109 ts_tablet_manager.cc:616] Registered 2 tablets
I20260812 08:03:10.680162 17109 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:10.690171 17109 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.2:45805
I20260812 08:03:10.690229 17349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.2:45805 every 8 connection(s)
I20260812 08:03:10.691036 17109 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:10.693665  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 17109
I20260812 08:03:10.694039  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.3:43175
--local_ip_for_outbound_sockets=127.8.228.3
--tserver_master_addrs=127.8.228.62:35979
--webserver_port=44331
--webserver_interface=127.8.228.3
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 08:03:10.699291 17350 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:03:10.699522 17350 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:10.700042 17350 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:03:10.701941 16761 ts_manager.cc:194] Registered new tserver with Master: f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:03:10.703116 16761 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.2:49007
I20260812 08:03:10.715696 17167 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Log is configured to *not* fsync() on all Append() calls
W20260812 08:03:10.795967 17360 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:10.796136 17360 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:10.796182 17360 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:10.799425 17360 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:10.799491 17360 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:03:10.799542 17360 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.3
I20260812 08:03:10.800462 17167 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:10.800807 17167 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap complete.
I20260812 08:03:10.801815 17167 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Time spent bootstrapping tablet: real 0.122s	user 0.114s	sys 0.004s
I20260812 08:03:10.803323 17360 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.3:43175
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.228.3
--webserver_port=44331
--flush_threshold_mb=0
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.17360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:10.803877 17167 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:10.804220 17167 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Initialized, Role: FOLLOWER
I20260812 08:03:10.804235 17360 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:10.804617 17167 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:10.805260 17350 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:03:10.805310 17360 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:03:10.805444 17167 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:03:10.805685 17167 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap starting.
W20260812 08:03:10.811496 17372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:10.811688 17360 server_base.cc:1061] running on GCE node
W20260812 08:03:10.811507 17381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.811873 17378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:10.812222 17360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:10.812682 17360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:10.813678 17353 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 95499 bytes on disk
I20260812 08:03:10.813832 17360 hybrid_clock.cc:648] HybridClock initialized: now 1786521790813813 us; error 34 us; skew 500 ppm
I20260812 08:03:10.814539 17164 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.001s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20260812 08:03:10.815474 17360 webserver.cc:533] Webserver started at http://127.8.228.3:44331/ using document root <none> and password file <none>
I20260812 08:03:10.815968 17360 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:10.816035 17360 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:10.819213 17360 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:03:10.825740 17404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:10.826565 17360 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
I20260812 08:03:10.826647 17360 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
uuid: "38605eeb040245c58a065d2ae5811a90"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:03:10.826967 17360 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/data
Total live blocks: 10
Total live bytes: 775423
Total live bytes (after alignment): 802816
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:10.840986 17360 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:10.841533 17360 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:10.841676 17360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:10.842156 17360 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:10.843277 17419 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260812 08:03:10.848970 17360 ts_tablet_manager.cc:585] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20260812 08:03:10.849030 17360 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.006s	user 0.000s	sys 0.000s
I20260812 08:03:10.849085 17360 ts_tablet_manager.cc:600] Registering tablets (0/2 complete)
I20260812 08:03:10.850849 17419 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Bootstrap starting.
I20260812 08:03:10.850895 17360 ts_tablet_manager.cc:616] Registered 2 tablets
I20260812 08:03:10.850934 17360 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:10.861253 17360 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.3:43175
I20260812 08:03:10.861295 17626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.3:43175 every 8 connection(s)
I20260812 08:03:10.862166 17360 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:10.871809  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 17360
I20260812 08:03:10.872188  9104 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
/tmp/dist-test-taskT1e2DF/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.228.4:44691
--local_ip_for_outbound_sockets=127.8.228.4
--tserver_master_addrs=127.8.228.62:35979
--webserver_port=37399
--webserver_interface=127.8.228.4
--builtin_ntp_servers=127.8.228.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 08:03:10.874856 17627 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:03:10.875077 17627 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:10.875517 17627 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:03:10.877208 16761 ts_manager.cc:194] Registered new tserver with Master: 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:03:10.878190 16761 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.3:47331
I20260812 08:03:10.895771 17419 log.cc:826] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:10.943634 17167 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:10.944022 17167 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Bootstrap complete.
I20260812 08:03:10.945227 17167 ts_tablet_manager.cc:1403] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Time spent bootstrapping tablet: real 0.140s	user 0.132s	sys 0.004s
I20260812 08:03:10.945864 17167 raft_consensus.cc:359] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:10.945991 17167 raft_consensus.cc:740] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Initialized, Role: FOLLOWER
I20260812 08:03:10.946159 17167 consensus_queue.cc:260] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:10.946484 17167 ts_tablet_manager.cc:1434] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 08:03:10.949062 17353 maintenance_manager.cc:419] P f492a4e4cbba4f93a706a4048833cbd6: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 95797 bytes on disk
I20260812 08:03:10.949499 17164 maintenance_manager.cc:643] P f492a4e4cbba4f93a706a4048833cbd6: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
W20260812 08:03:10.978147 17635 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:10.978308 17635 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:10.978390 17635 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:10.981602 17635 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:10.981683 17635 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 08:03:10.981755 17635 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.228.4
I20260812 08:03:10.985458 17635 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.228.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.228.4:44691
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.8.228.4
--webserver_port=37399
--flush_threshold_mb=0
--tserver_master_addrs=127.8.228.62:35979
--never_fsync=true
--heap_profile_path=/tmp/kudu.17635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.228.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:10.986435 17635 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:10.987365 17635 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:10.992980 17646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.992995 17648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:10.992996 17643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:10.993566 17635 server_base.cc:1061] running on GCE node
I20260812 08:03:10.993872 17635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:10.994323 17635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:10.995507 17635 hybrid_clock.cc:648] HybridClock initialized: now 1786521790995479 us; error 41 us; skew 500 ppm
I20260812 08:03:10.996155 17419 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:10.996541 17419 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Bootstrap complete.
I20260812 08:03:10.996994 17635 webserver.cc:533] Webserver started at http://127.8.228.4:37399/ using document root <none> and password file <none>
I20260812 08:03:10.997453 17635 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:10.997504 17635 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:10.997601 17419 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Time spent bootstrapping tablet: real 0.147s	user 0.134s	sys 0.008s
I20260812 08:03:10.999529 17419 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:10.999898 17419 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38605eeb040245c58a065d2ae5811a90, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.000303 17419 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:11.000614 17635 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:11.000885 17627 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:03:11.001032 17419 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90: Time spent starting tablet: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:03:11.001268 17419 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Bootstrap starting.
I20260812 08:03:11.006122 17629 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40): 95499 bytes on disk
I20260812 08:03:11.006980 17676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:11.006938 17417 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(a6a1bb938f084feda86bec0572064f40) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20260812 08:03:11.007946 17635 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
I20260812 08:03:11.008039 17635 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data,/tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
uuid: "e148dcbee1fe4d96bab45f72a90418a4"
format_stamp: "Formatted at 2026-08-12 08:02:52 on dist-test-slave-6zbq"
I20260812 08:03:11.008339 17635 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/data
Total live blocks: 5
Total live bytes: 387870
Total live bytes (after alignment): 401408
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:11.022133 17635 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:11.022643 17635 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:11.022791 17635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:11.023257 17635 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:11.024317 17685 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260812 08:03:11.029541 17635 ts_tablet_manager.cc:585] Loaded tablet metadata (2 total tablets, 1 live tablets)
I20260812 08:03:11.029610 17635 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.000s	sys 0.000s
I20260812 08:03:11.029671 17635 ts_tablet_manager.cc:600] Registering tablets (0/2 complete)
I20260812 08:03:11.030506 17635 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:11.030555 17635 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:03:11.030833 17685 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap starting.
I20260812 08:03:11.041785 17635 rpc_server.cc:307] RPC server started. Bound to: 127.8.228.4:44691
I20260812 08:03:11.041831 17871 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.228.4:44691 every 8 connection(s)
I20260812 08:03:11.042858 17635 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb
I20260812 08:03:11.052225  9104 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu as pid 17635
I20260812 08:03:11.053597 17873 heartbeater.cc:344] Connected to a master server at 127.8.228.62:35979
I20260812 08:03:11.053854 17873 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:11.055284 17873 heartbeater.cc:507] Master 127.8.228.62:35979 requested a full tablet report, sending...
I20260812 08:03:11.058753 16761 ts_manager.cc:194] Registered new tserver with Master: e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691)
I20260812 08:03:11.059783 16761 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.228.4:39653
I20260812 08:03:11.070001 17685 log.cc:826] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:11.070499  9104 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 08:03:11.070582  9104 tablet_copy-itest.cc:1615] Running ksck...
I20260812 08:03:11.123921 17419 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:11.124282 17419 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Bootstrap complete.
I20260812 08:03:11.125332 17419 ts_tablet_manager.cc:1403] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Time spent bootstrapping tablet: real 0.124s	user 0.117s	sys 0.004s
I20260812 08:03:11.125885 17419 raft_consensus.cc:359] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:11.125996 17419 raft_consensus.cc:740] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38605eeb040245c58a065d2ae5811a90, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.126121 17419 consensus_queue.cc:260] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:11.126385 17419 ts_tablet_manager.cc:1434] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 08:03:11.132189 17492 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.133881 17629 maintenance_manager.cc:419] P 38605eeb040245c58a065d2ae5811a90: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 95797 bytes on disk
I20260812 08:03:11.134295 17417 maintenance_manager.cc:643] P 38605eeb040245c58a065d2ae5811a90: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20260812 08:03:11.140974 17236 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.141885 16964 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.146817 17745 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 12e3751703744ce7a01d6b70ca4ac8f0 | 127.8.228.62:35979 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                               |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 38605eeb040245c58a065d2ae5811a90 | 127.8.228.3:43175 | HEALTHY | <none>   |       0        |       0
 cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | HEALTHY | <none>   |       0        |       0
 e148dcbee1fe4d96bab45f72a90418a4 | 127.8.228.4:44691 | HEALTHY | <none>   |       0        |       0
 f492a4e4cbba4f93a706a4048833cbd6 | 127.8.228.2:45805 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                             |         Tags         |      Tablet Server
-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                             | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                           | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.8.228.1                                                                                                                                                   | experimental         | 127.8.228.1:34007
 local_ip_for_outbound_sockets           | 127.8.228.2                                                                                                                                                   | experimental         | 127.8.228.2:45805
 local_ip_for_outbound_sockets           | 127.8.228.3                                                                                                                                                   | experimental         | 127.8.228.3:43175
 local_ip_for_outbound_sockets           | 127.8.228.4                                                                                                                                                   | experimental         | 127.8.228.4:44691
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                            | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                          | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                             | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                          | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                            | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.8.228.1:34007
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.8.228.2:45805
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.8.228.3:43175
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.8.228.4:44691
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                             | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 7dc68e6a467043928d0404bca8788431 of table 'table_b' is under-replicated: 1 replica(s) not RUNNING
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): not running [LEADER]
    State:       BOOTSTRAPPING
    Data state:  TABLET_DATA_READY
    Last status: Bootstrap starting.
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
All reported replicas are:
  A = e148dcbee1fe4d96bab45f72a90418a4
  B = f492a4e4cbba4f93a706a4048833cbd6
  C = 38605eeb040245c58a065d2ae5811a90
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

Tablet a6a1bb938f084feda86bec0572064f40 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
  cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): RUNNING
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING [LEADER]
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = 38605eeb040245c58a065d2ae5811a90
  B = cc83802806d14ecba59903d3d4d6bf7f
  C = f492a4e4cbba4f93a706a4048833cbd6
  D = e148dcbee1fe4d96bab45f72a90418a4
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B   C*  D~   |              |              | Yes
 A             | A   B   C   D~   | 1            | 206          | Yes
 B             | A   B   C        | 1            | -1           | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | UNDER_REPLICATED   | 1             | 0       | 0          | 1                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 08:03:11.171046  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:03:11.193320 17685 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:11.193651 17685 tablet_bootstrap.cc:492] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap complete.
I20260812 08:03:11.194633 17685 ts_tablet_manager.cc:1403] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Time spent bootstrapping tablet: real 0.164s	user 0.130s	sys 0.012s
I20260812 08:03:11.196552 17685 raft_consensus.cc:359] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:11.196877 17685 raft_consensus.cc:740] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e148dcbee1fe4d96bab45f72a90418a4, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.197268 17685 consensus_queue.cc:260] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:11.197841 17873 heartbeater.cc:499] Master 127.8.228.62:35979 was elected leader, sending a full tablet report...
I20260812 08:03:11.197992 17685 ts_tablet_manager.cc:1434] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:11.206387 17874 maintenance_manager.cc:419] P e148dcbee1fe4d96bab45f72a90418a4: Scheduling UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431): 95797 bytes on disk
I20260812 08:03:11.207083 17683 maintenance_manager.cc:643] P e148dcbee1fe4d96bab45f72a90418a4: UndoDeltaBlockGCOp(7dc68e6a467043928d0404bca8788431) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20260812 08:03:11.366266 17492 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.366573 17745 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.366658 16964 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.368541 17236 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 12e3751703744ce7a01d6b70ca4ac8f0 | 127.8.228.62:35979 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                               |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 38605eeb040245c58a065d2ae5811a90 | 127.8.228.3:43175 | HEALTHY | <none>   |       0        |       0
 cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | HEALTHY | <none>   |       0        |       0
 e148dcbee1fe4d96bab45f72a90418a4 | 127.8.228.4:44691 | HEALTHY | <none>   |       0        |       0
 f492a4e4cbba4f93a706a4048833cbd6 | 127.8.228.2:45805 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                             |         Tags         |      Tablet Server
-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                             | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                           | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.8.228.1                                                                                                                                                   | experimental         | 127.8.228.1:34007
 local_ip_for_outbound_sockets           | 127.8.228.2                                                                                                                                                   | experimental         | 127.8.228.2:45805
 local_ip_for_outbound_sockets           | 127.8.228.3                                                                                                                                                   | experimental         | 127.8.228.3:43175
 local_ip_for_outbound_sockets           | 127.8.228.4                                                                                                                                                   | experimental         | 127.8.228.4:44691
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                            | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                          | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                             | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                          | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                            | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.8.228.1:34007
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.8.228.2:45805
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.8.228.3:43175
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.8.228.4:44691
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                             | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet a6a1bb938f084feda86bec0572064f40 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
  cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): RUNNING
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING [LEADER]
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = 38605eeb040245c58a065d2ae5811a90
  B = cc83802806d14ecba59903d3d4d6bf7f
  C = f492a4e4cbba4f93a706a4048833cbd6
  D = e148dcbee1fe4d96bab45f72a90418a4
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B   C*  D~   |              |              | Yes
 A             | A   B   C   D~   | 1            | 206          | Yes
 B             | A   B   C        | 1            | -1           | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

Tablet 7dc68e6a467043928d0404bca8788431 of table 'table_b' is conflicted: 3 replicas' active configs disagree with the leader master's
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): RUNNING [LEADER]
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
All reported replicas are:
  A = e148dcbee1fe4d96bab45f72a90418a4
  B = f492a4e4cbba4f93a706a4048833cbd6
  C = 38605eeb040245c58a065d2ae5811a90
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 08:03:11.394214  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:03:11.665752 17492 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.665795 16964 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.666047 17236 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:11.666684 17745 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 12e3751703744ce7a01d6b70ca4ac8f0 | 127.8.228.62:35979 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                               |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 38605eeb040245c58a065d2ae5811a90 | 127.8.228.3:43175 | HEALTHY | <none>   |       0        |       0
 cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | HEALTHY | <none>   |       0        |       0
 e148dcbee1fe4d96bab45f72a90418a4 | 127.8.228.4:44691 | HEALTHY | <none>   |       0        |       0
 f492a4e4cbba4f93a706a4048833cbd6 | 127.8.228.2:45805 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                             |         Tags         |      Tablet Server
-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                             | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                           | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.8.228.1                                                                                                                                                   | experimental         | 127.8.228.1:34007
 local_ip_for_outbound_sockets           | 127.8.228.2                                                                                                                                                   | experimental         | 127.8.228.2:45805
 local_ip_for_outbound_sockets           | 127.8.228.3                                                                                                                                                   | experimental         | 127.8.228.3:43175
 local_ip_for_outbound_sockets           | 127.8.228.4                                                                                                                                                   | experimental         | 127.8.228.4:44691
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                            | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                          | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                             | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                          | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                            | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.8.228.1:34007
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.8.228.2:45805
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.8.228.3:43175
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.8.228.4:44691
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                             | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 7dc68e6a467043928d0404bca8788431 of table 'table_b' is conflicted: 3 replicas' active configs disagree with the leader master's
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): RUNNING [LEADER]
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
All reported replicas are:
  A = e148dcbee1fe4d96bab45f72a90418a4
  B = f492a4e4cbba4f93a706a4048833cbd6
  C = 38605eeb040245c58a065d2ae5811a90
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

Tablet a6a1bb938f084feda86bec0572064f40 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
  cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): RUNNING
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING [LEADER]
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = 38605eeb040245c58a065d2ae5811a90
  B = cc83802806d14ecba59903d3d4d6bf7f
  C = f492a4e4cbba4f93a706a4048833cbd6
  D = e148dcbee1fe4d96bab45f72a90418a4
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B   C*  D~   |              |              | Yes
 A             | A   B   C   D~   | 1            | 206          | Yes
 B             | A   B   C        | 1            | -1           | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 08:03:11.695272  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:03:12.092622 17492 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:12.093385 17745 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:12.093763 16964 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:12.093876 17236 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 12e3751703744ce7a01d6b70ca4ac8f0 | 127.8.228.62:35979 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                               |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 38605eeb040245c58a065d2ae5811a90 | 127.8.228.3:43175 | HEALTHY | <none>   |       0        |       0
 cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | HEALTHY | <none>   |       0        |       0
 e148dcbee1fe4d96bab45f72a90418a4 | 127.8.228.4:44691 | HEALTHY | <none>   |       0        |       0
 f492a4e4cbba4f93a706a4048833cbd6 | 127.8.228.2:45805 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                             |         Tags         |      Tablet Server
-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                             | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                           | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.8.228.1                                                                                                                                                   | experimental         | 127.8.228.1:34007
 local_ip_for_outbound_sockets           | 127.8.228.2                                                                                                                                                   | experimental         | 127.8.228.2:45805
 local_ip_for_outbound_sockets           | 127.8.228.3                                                                                                                                                   | experimental         | 127.8.228.3:43175
 local_ip_for_outbound_sockets           | 127.8.228.4                                                                                                                                                   | experimental         | 127.8.228.4:44691
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                            | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                          | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                             | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                          | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                            | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.8.228.1:34007
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.8.228.2:45805
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.8.228.3:43175
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.8.228.4:44691
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                             | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 7dc68e6a467043928d0404bca8788431 of table 'table_b' is conflicted: 3 replicas' active configs disagree with the leader master's
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): RUNNING [LEADER]
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
All reported replicas are:
  A = e148dcbee1fe4d96bab45f72a90418a4
  B = f492a4e4cbba4f93a706a4048833cbd6
  C = 38605eeb040245c58a065d2ae5811a90
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

Tablet a6a1bb938f084feda86bec0572064f40 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
  cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): RUNNING
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING [LEADER]
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = 38605eeb040245c58a065d2ae5811a90
  B = cc83802806d14ecba59903d3d4d6bf7f
  C = f492a4e4cbba4f93a706a4048833cbd6
  D = e148dcbee1fe4d96bab45f72a90418a4
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B   C*  D~   |              |              | Yes
 A             | A   B   C   D~   | 1            | 206          | Yes
 B             | A   B   C        | 1            | -1           | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 08:03:12.122242  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:03:12.283171 18078 raft_consensus.cc:493] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:12.283361 18078 raft_consensus.cc:515] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:03:12.284417 18078 leader_election.cc:290] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175), f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:03:12.288718 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "cc83802806d14ecba59903d3d4d6bf7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "f492a4e4cbba4f93a706a4048833cbd6" is_pre_election: true
I20260812 08:03:12.288915 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "cc83802806d14ecba59903d3d4d6bf7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90" is_pre_election: true
I20260812 08:03:12.289022 17272 raft_consensus.cc:2410] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc83802806d14ecba59903d3d4d6bf7f for term 2 because replica has last-logged OpId of term: 1 index: 206, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 205.
I20260812 08:03:12.289181 17530 raft_consensus.cc:2410] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc83802806d14ecba59903d3d4d6bf7f for term 2 because replica has last-logged OpId of term: 1 index: 206, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 205.
I20260812 08:03:12.289628 16892 leader_election.cc:304] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc83802806d14ecba59903d3d4d6bf7f; no voters: 38605eeb040245c58a065d2ae5811a90, f492a4e4cbba4f93a706a4048833cbd6
I20260812 08:03:12.289842 18078 raft_consensus.cc:2749] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:03:12.407692 18088 raft_consensus.cc:493] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:12.407873 18088 raft_consensus.cc:515] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:12.409006 18088 leader_election.cc:290] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691), 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:03:12.412810 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90" is_pre_election: true
I20260812 08:03:12.412863 17794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "e148dcbee1fe4d96bab45f72a90418a4" is_pre_election: true
I20260812 08:03:12.413000 17530 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 1.
I20260812 08:03:12.413164 17794 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 1.
I20260812 08:03:12.413347 17158 leader_election.cc:304] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:03:12.413571 18088 raft_consensus.cc:2804] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:12.413659 18088 raft_consensus.cc:493] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:12.413708 18088 raft_consensus.cc:3060] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.415504 18088 raft_consensus.cc:515] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:12.415839 18088 leader_election.cc:290] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 election: Requested vote from peers e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691), 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175)
I20260812 08:03:12.416175 17794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "e148dcbee1fe4d96bab45f72a90418a4"
I20260812 08:03:12.416193 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc68e6a467043928d0404bca8788431" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 205 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90"
I20260812 08:03:12.416297 17794 raft_consensus.cc:3060] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.416312 17530 raft_consensus.cc:3060] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.418141 17794 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 2.
I20260812 08:03:12.418141 17530 raft_consensus.cc:2468] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 2.
I20260812 08:03:12.418437 17158 leader_election.cc:304] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:03:12.418607 18088 raft_consensus.cc:2804] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:12.418772 18088 raft_consensus.cc:697] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 LEADER]: Becoming Leader. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Running, Role: LEADER
I20260812 08:03:12.419037 18088 consensus_queue.cc:237] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 205, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } }
I20260812 08:03:12.421816 16758 catalog_manager.cc:5719] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 reported cstate change: term changed from 1 to 2, leader changed from e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) to f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2). New cstate: current_term: 2 leader_uuid: "f492a4e4cbba4f93a706a4048833cbd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } health_report { overall_health: UNKNOWN } } }
I20260812 08:03:12.568011 18088 raft_consensus.cc:493] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:12.568120 18088 raft_consensus.cc:515] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:12.568588 18088 leader_election.cc:290] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175), cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:03:12.568977 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90" is_pre_election: true
I20260812 08:03:12.569111 17530 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 1.
I20260812 08:03:12.569396 17158 leader_election.cc:304] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:03:12.569581 18088 raft_consensus.cc:2804] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:12.569648 18088 raft_consensus.cc:493] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:12.569692 18088 raft_consensus.cc:3060] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.570568 18088 raft_consensus.cc:515] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:12.570884 18088 leader_election.cc:290] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 election: Requested vote from peers 38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175), cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007)
I20260812 08:03:12.571237 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "38605eeb040245c58a065d2ae5811a90"
I20260812 08:03:12.571350 17530 raft_consensus.cc:3060] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.572263 17530 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 2.
I20260812 08:03:12.572279 16993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "cc83802806d14ecba59903d3d4d6bf7f" is_pre_election: true
I20260812 08:03:12.572359 17034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a1bb938f084feda86bec0572064f40" candidate_uuid: "f492a4e4cbba4f93a706a4048833cbd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "cc83802806d14ecba59903d3d4d6bf7f"
I20260812 08:03:12.572526 16993 raft_consensus.cc:2468] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f492a4e4cbba4f93a706a4048833cbd6 in term 1.
I20260812 08:03:12.572592 17158 leader_election.cc:304] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38605eeb040245c58a065d2ae5811a90, f492a4e4cbba4f93a706a4048833cbd6; no voters: 
I20260812 08:03:12.572775 18088 raft_consensus.cc:2804] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:12.572860 18088 raft_consensus.cc:697] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 LEADER]: Becoming Leader. State: Replica: f492a4e4cbba4f93a706a4048833cbd6, State: Running, Role: LEADER
I20260812 08:03:12.573001 18088 consensus_queue.cc:237] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 206, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:12.574777 16758 catalog_manager.cc:5719] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f492a4e4cbba4f93a706a4048833cbd6" committed_config { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 08:03:12.672649 17492 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:12.673740 16964 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:12.674156 17745 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:12.679361 17236 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 12e3751703744ce7a01d6b70ca4ac8f0 | 127.8.228.62:35979 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                               |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 38605eeb040245c58a065d2ae5811a90 | 127.8.228.3:43175 | HEALTHY | <none>   |       0        |       0
 cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | HEALTHY | <none>   |       0        |       0
 e148dcbee1fe4d96bab45f72a90418a4 | 127.8.228.4:44691 | HEALTHY | <none>   |       0        |       0
 f492a4e4cbba4f93a706a4048833cbd6 | 127.8.228.2:45805 | HEALTHY | <none>   |       2        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                             |         Tags         |      Tablet Server
-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                             | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                           | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.8.228.1                                                                                                                                                   | experimental         | 127.8.228.1:34007
 local_ip_for_outbound_sockets           | 127.8.228.2                                                                                                                                                   | experimental         | 127.8.228.2:45805
 local_ip_for_outbound_sockets           | 127.8.228.3                                                                                                                                                   | experimental         | 127.8.228.3:43175
 local_ip_for_outbound_sockets           | 127.8.228.4                                                                                                                                                   | experimental         | 127.8.228.4:44691
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                            | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                          | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                             | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                          | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                            | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.8.228.1:34007
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.8.228.2:45805
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.8.228.3:43175
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.8.228.4:44691
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                             | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 7dc68e6a467043928d0404bca8788431 of table 'table_b' is conflicted: 2 replicas' active configs disagree with the leader master's
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): RUNNING
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING [LEADER]
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
All reported replicas are:
  A = e148dcbee1fe4d96bab45f72a90418a4
  B = f492a4e4cbba4f93a706a4048833cbd6
  C = 38605eeb040245c58a065d2ae5811a90
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B   C    | 2            | -1           | Yes
 B             | A   B*  C    | 2            | -1           | Yes
 C             | A   B   C    | 2            | -1           | Yes

Tablet a6a1bb938f084feda86bec0572064f40 of table 'table_a' is conflicted: 3 replicas' active configs disagree with the leader master's
  38605eeb040245c58a065d2ae5811a90 (127.8.228.3:43175): RUNNING
  cc83802806d14ecba59903d3d4d6bf7f (127.8.228.1:34007): RUNNING
  f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805): RUNNING [LEADER]
  e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = 38605eeb040245c58a065d2ae5811a90
  B = cc83802806d14ecba59903d3d4d6bf7f
  C = f492a4e4cbba4f93a706a4048833cbd6
  D = e148dcbee1fe4d96bab45f72a90418a4
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B   C*  D~   |              |              | Yes
 A             | A   B   C   D~   | 2            | 206          | Yes
 B             | A   B   C        | 1            | -1           | Yes
 C             | A   B   C*  D~   | 2            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 08:03:12.704813  9104 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:03:12.983551 17794 raft_consensus.cc:1275] T 7dc68e6a467043928d0404bca8788431 P e148dcbee1fe4d96bab45f72a90418a4 [term 2 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 2 index: 206. (index mismatch)
I20260812 08:03:12.984175 18088 consensus_queue.cc:1048] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: VOTER last_known_addr { host: "127.8.228.4" port: 44691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
I20260812 08:03:12.988348 17530 raft_consensus.cc:1275] T 7dc68e6a467043928d0404bca8788431 P 38605eeb040245c58a065d2ae5811a90 [term 2 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 2 index: 206. (index mismatch)
I20260812 08:03:12.988988 18164 consensus_queue.cc:1048] T 7dc68e6a467043928d0404bca8788431 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
I20260812 08:03:12.989154 17530 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 2 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
I20260812 08:03:12.989665 18164 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20260812 08:03:12.992868 17034 raft_consensus.cc:3060] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.995039 17034 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 2 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
W20260812 08:03:12.995525 17161 consensus_peers.cc:597] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 -> Peer e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): Couldn't send request to peer e148dcbee1fe4d96bab45f72a90418a4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:12.995757 18088 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 205, Time since last communication: 0.000s
I20260812 08:03:12.997509 17034 raft_consensus.cc:2955] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 2 FOLLOWER]: Committing config change with OpId 1.206: config changed from index -1 to 206, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } } }
I20260812 08:03:13.422580 18184 tablet_replica.cc:333] stopping tablet replica
I20260812 08:03:13.422724 18184 raft_consensus.cc:2243] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 LEARNER]: Raft consensus shutting down.
I20260812 08:03:13.422802 18184 raft_consensus.cc:2272] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 1 LEARNER]: Raft consensus is shut down!
I20260812 08:03:13.422919 18184 ts_tablet_manager.cc:933] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Initiating tablet copy from peer f492a4e4cbba4f93a706a4048833cbd6 (127.8.228.2:45805)
I20260812 08:03:13.423410 18184 tablet_copy_client.cc:323] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Beginning tablet copy session from remote peer at address 127.8.228.2:45805
I20260812 08:03:13.427253 17303 tablet_copy_service.cc:140] P f492a4e4cbba4f93a706a4048833cbd6: Received BeginTabletCopySession request for tablet a6a1bb938f084feda86bec0572064f40 from peer e148dcbee1fe4d96bab45f72a90418a4 ({username='slave'} at 127.8.228.4:50211)
I20260812 08:03:13.427381 17303 tablet_copy_service.cc:161] P f492a4e4cbba4f93a706a4048833cbd6: Beginning new tablet copy session on tablet a6a1bb938f084feda86bec0572064f40 from peer e148dcbee1fe4d96bab45f72a90418a4 at {username='slave'} at 127.8.228.4:50211: session id = e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40
I20260812 08:03:13.428647 17303 tablet_copy_source_session.cc:215] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6: Tablet Copy: opened 5 blocks and 1 log segments
I20260812 08:03:13.430158 18184 ts_tablet_manager.cc:1916] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:03:13.432212 18184 ts_tablet_manager.cc:1929] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20260812 08:03:13.432524 18184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a1bb938f084feda86bec0572064f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:13.433498 18184 tablet_copy_client.cc:806] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Starting download of 5 data blocks...
I20260812 08:03:13.440238 18184 tablet_copy_client.cc:670] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:03:13.443989 18184 tablet_copy_client.cc:538] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:03:13.445346 18184 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap starting.
I20260812 08:03:13.502944 17272 consensus_queue.cc:237] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 207, Committed index: 207, Last appended: 2.207, Last appended by leader: 206, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } }
I20260812 08:03:13.504292 17530 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 2 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20260812 08:03:13.504302 17034 raft_consensus.cc:1275] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 2 FOLLOWER]: Refusing update from remote peer f492a4e4cbba4f93a706a4048833cbd6: Log matching property violated. Preceding OpId in replica: term: 2 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20260812 08:03:13.504854 18224 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20260812 08:03:13.506465 18088 raft_consensus.cc:2955] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [term 2 LEADER]: Committing config change with OpId 2.208: config changed from index 206 to 208, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } }
I20260812 08:03:13.506930 17034 raft_consensus.cc:2955] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f [term 2 FOLLOWER]: Committing config change with OpId 2.208: config changed from index 206 to 208, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } }
I20260812 08:03:13.508597 18224 consensus_queue.cc:1048] T a6a1bb938f084feda86bec0572064f40 P f492a4e4cbba4f93a706a4048833cbd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20260812 08:03:13.508838 16741 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet a6a1bb938f084feda86bec0572064f40 with cas_config_opid_index 206: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 08:03:13.509829 17530 raft_consensus.cc:2955] T a6a1bb938f084feda86bec0572064f40 P 38605eeb040245c58a065d2ae5811a90 [term 2 FOLLOWER]: Committing config change with OpId 2.208: config changed from index 206 to 208, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } }
I20260812 08:03:13.511958 16758 catalog_manager.cc:5719] T a6a1bb938f084feda86bec0572064f40 P cc83802806d14ecba59903d3d4d6bf7f reported cstate change: config changed from index 206 to 208, NON_VOTER e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4) evicted. New cstate: current_term: 2 leader_uuid: "f492a4e4cbba4f93a706a4048833cbd6" committed_config { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } }
I20260812 08:03:13.521970 17745 tablet_service.cc:1558] Processing DeleteTablet for tablet a6a1bb938f084feda86bec0572064f40 with delete_type TABLET_DATA_TOMBSTONED (TS e148dcbee1fe4d96bab45f72a90418a4 not found in new config with opid_index 208) from {username='slave'} at 127.0.0.1:57710
W20260812 08:03:13.528178 16741 catalog_manager.cc:5030] TS e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): delete failed for tablet a6a1bb938f084feda86bec0572064f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6a1bb938f084feda86bec0572064f40 already in progress: copying tablet
I20260812 08:03:13.528795 16964 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:13.529598 17236 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260812 08:03:13.530254 17745 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:03:13.535926 17492 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 12e3751703744ce7a01d6b70ca4ac8f0 | 127.8.228.62:35979 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                               |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 38605eeb040245c58a065d2ae5811a90 | 127.8.228.3:43175 | HEALTHY | <none>   |       0        |       0
 cc83802806d14ecba59903d3d4d6bf7f | 127.8.228.1:34007 | HEALTHY | <none>   |       0        |       0
 e148dcbee1fe4d96bab45f72a90418a4 | 127.8.228.4:44691 | HEALTHY | <none>   |       0        |       0
 f492a4e4cbba4f93a706a4048833cbd6 | 127.8.228.2:45805 | HEALTHY | <none>   |       2        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                             |         Tags         |      Tablet Server
-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                             | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                           | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.8.228.1                                                                                                                                                   | experimental         | 127.8.228.1:34007
 local_ip_for_outbound_sockets           | 127.8.228.2                                                                                                                                                   | experimental         | 127.8.228.2:45805
 local_ip_for_outbound_sockets           | 127.8.228.3                                                                                                                                                   | experimental         | 127.8.228.3:43175
 local_ip_for_outbound_sockets           | 127.8.228.4                                                                                                                                                   | experimental         | 127.8.228.4:44691
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                            | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                          | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                             | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                          | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                            | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.8.228.1:34007
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.8.228.2:45805
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.8.228.3:43175
 server_dump_info_path                   | /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.8.228.4:44691
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                             | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.8.228.20:38057 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
  Name   | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+---------+---------------+---------+------------+------------------+-------------
 table_a | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0
 table_b | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 6

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:03:13.565495  9104 log_verifier.cc:126] Checking tablet 7dc68e6a467043928d0404bca8788431
I20260812 08:03:13.573010 18184 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:13.573341 18184 tablet_bootstrap.cc:492] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Bootstrap complete.
I20260812 08:03:13.573618 18184 ts_tablet_manager.cc:1403] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Time spent bootstrapping tablet: real 0.128s	user 0.108s	sys 0.016s
I20260812 08:03:13.574263 18184 raft_consensus.cc:359] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:13.574433 18184 raft_consensus.cc:740] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e148dcbee1fe4d96bab45f72a90418a4, State: Initialized, Role: LEARNER
I20260812 08:03:13.574625 18184 consensus_queue.cc:260] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 2.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "38605eeb040245c58a065d2ae5811a90" member_type: VOTER last_known_addr { host: "127.8.228.3" port: 43175 } } peers { permanent_uuid: "cc83802806d14ecba59903d3d4d6bf7f" member_type: VOTER last_known_addr { host: "127.8.228.1" port: 34007 } } peers { permanent_uuid: "f492a4e4cbba4f93a706a4048833cbd6" member_type: VOTER last_known_addr { host: "127.8.228.2" port: 45805 } } peers { permanent_uuid: "e148dcbee1fe4d96bab45f72a90418a4" member_type: NON_VOTER last_known_addr { host: "127.8.228.4" port: 44691 } attrs { promote: true } }
I20260812 08:03:13.575038 18184 ts_tablet_manager.cc:1434] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 08:03:13.575794 17303 tablet_copy_service.cc:342] P f492a4e4cbba4f93a706a4048833cbd6: Request end of tablet copy session e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40 received from {username='slave'} at 127.8.228.4:50211
I20260812 08:03:13.575920 17303 tablet_copy_service.cc:434] P f492a4e4cbba4f93a706a4048833cbd6: ending tablet copy session e148dcbee1fe4d96bab45f72a90418a4-a6a1bb938f084feda86bec0572064f40 on tablet a6a1bb938f084feda86bec0572064f40 with peer e148dcbee1fe4d96bab45f72a90418a4
I20260812 08:03:13.576864 17745 tablet_service.cc:1558] Processing DeleteTablet for tablet a6a1bb938f084feda86bec0572064f40 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 206 (current committed config index is 208)) from {username='slave'} at 127.0.0.1:57710
I20260812 08:03:13.577114 18248 tablet_replica.cc:333] stopping tablet replica
I20260812 08:03:13.577359 18248 raft_consensus.cc:2243] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 2 LEARNER]: Raft consensus shutting down.
I20260812 08:03:13.577570 18248 raft_consensus.cc:2272] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4 [term 2 LEARNER]: Raft consensus is shut down!
I20260812 08:03:13.578699 18248 ts_tablet_manager.cc:1916] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:03:13.582041 18248 ts_tablet_manager.cc:1929] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.207
I20260812 08:03:13.582125 18248 log.cc:1199] T a6a1bb938f084feda86bec0572064f40 P e148dcbee1fe4d96bab45f72a90418a4: Deleting WAL directory at /tmp/dist-test-taskT1e2DF/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786521716701421-9104-0/minicluster-data/ts-3/wal/wals/a6a1bb938f084feda86bec0572064f40
I20260812 08:03:13.582837 16741 catalog_manager.cc:5050] TS e148dcbee1fe4d96bab45f72a90418a4 (127.8.228.4:44691): tablet a6a1bb938f084feda86bec0572064f40 (table table_a [id=bcdf38cbb8b44f78851861b7d36b8506]) successfully deleted
I20260812 08:03:13.664873  9104 log_verifier.cc:177] Verified matching terms for 206 ops in tablet 7dc68e6a467043928d0404bca8788431
I20260812 08:03:13.664999  9104 log_verifier.cc:126] Checking tablet a6a1bb938f084feda86bec0572064f40
I20260812 08:03:13.759262  9104 log_verifier.cc:177] Verified matching terms for 208 ops in tablet a6a1bb938f084feda86bec0572064f40
I20260812 08:03:13.759428  9104 tablet_copy-itest.cc:1620] Checking row count...
I20260812 08:03:13.925792  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 16829
I20260812 08:03:13.938947  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 17109
I20260812 08:03:13.955339  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 17360
I20260812 08:03:13.968961  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 17635
I20260812 08:03:13.979403  9104 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskT1e2DF/build/debug/bin/kudu with pid 16701
2026-08-12T08:03:13Z chronyd exiting
[       OK ] FaultFlags/BadTabletCopyITest.TestBadCopy/1 (22374 ms)
[----------] 1 test from FaultFlags/BadTabletCopyITest (22374 ms total)

[----------] Global test environment tear-down
[==========] 5 tests from 2 test suites ran. (77302 ms total)
[  PASSED  ] 5 tests.
I20260812 08:03:14.014667  9104 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/integration-tests/tablet_copy-itest.cc:1499: suppressed but not reported on 49 messages since previous log ~15 seconds ago
I20260812 08:03:14.014735  9104 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/client/batcher.cc:441: suppressed but not reported on 3 messages since previous log ~70 seconds ago
I20260812 08:03:14.014760  9104 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 3 messages since previous log ~70 seconds ago
